In a mixing bowl, combine the creamy peanut butter, softened butter, and vanilla extract. Mix until smooth.

Gradually add the sifted powdered sugar, mixing on low speed until incorporated.

Add milk, one tablespoon at a time, until the frosting reaches your desired consistency.

Once mixed, use a spatula to scrape down the sides of the bowl and ensure everything is well combined.