Prep and Preheat
Preheat your oven to 400°F (200°C).
Line baking sheets with parchment paper for easy cleanup.
Mix the Dry Ingredients
Whisk together the flour, baking powder, and salt in a medium bowl. Set aside.
Cream the Wet Ingredients
In a large mixing bowl, beat the butter and sugar until light and fluffy.
Add the eggs, vanilla extract, and almond extract (if using) and mix until smooth.
Combine Wet and Dry Ingredients
Gradually add the dry ingredients to the wet mixture, alternating with the milk.
Mix until a soft dough forms. If the dough is sticky, refrigerate it for 30 minutes.
Roll and Cut
Roll out the dough on a lightly floured surface to about ¼-inch thickness.
Use festive cookie cutters to cut out shapes, then transfer them to the prepared baking sheets.
Bake
Bake for 6-8 minutes or until the edges are barely golden.
Let the cookies cool on the baking sheets for 5 minutes before transferring them to a wire rack to cool completely.
Make the Icing
Whisk together the powdered sugar, milk, and vanilla extract in a bowl until smooth.
Divide the icing into bowls and add food coloring for desired festive hues.
Decorate
Spread or pipe the icing onto the cooled cookies.
Decorate with sprinkles for a festive touch. Let the icing set before serving or storing.