Beat the softened butter and sugar together until pale and fluffy, about 2-3 minutes.
Beat in the vanilla, then the eggs one at a time, scraping down the bowl between additions.
Whisk the flour, baking powder, and salt together, then mix into the butter mixture just until combined.
Divide the dough in half, shape into discs, wrap tightly, and refrigerate at least 2 hours.
Preheat the oven to 350F. Roll one disc to 1/4 inch thick, cut into shapes, and place 1 inch apart on parchment-lined sheets.
Bake for 9-10 minutes, until just set. Cool on the pan 5 minutes, then move to a wire rack. Repeat with the second disc.
Whisk the icing ingredients together, adding milk gradually until smooth and pourable.
Decorate cooled cookies with icing and let set at room temperature at least 3 hours before storing.