Make the Cookies:
Preheat oven to 350°F (175°C). Line baking sheets with parchment paper.
Whisk together flour, baking powder, and salt in a medium bowl. Set aside.
In a large mixing bowl, cream butter and sugar together until light and fluffy (about 2–3 minutes).
Beat in the egg, vanilla extract, and almond extract (if using) until well combined.
Gradually add dry ingredients to the wet mixture, mixing until the dough comes together.
Divide the dough in half, flatten into discs, wrap in plastic wrap, and chill for 1 hour.
On a floured surface, roll out dough to 1/4 inch thickness. Cut out cookies using a heart-shaped cookie cutter.
Place cookies on the prepared baking sheet, spacing 1 inch apart.
Bake for 8–10 minutes, or until the edges are just barely golden.
Let cookies cool on the pan for 5 minutes, then transfer to a wire rack to cool completely.
Make the Icing (Optional):
In a bowl, whisk together powdered sugar, milk, corn syrup, and vanilla until smooth. Add more milk (a few drops at a time) for desired consistency.
Divide into bowls and add food coloring if desired.
Decorate cooled cookies using piping bags or a spoon. Add sprinkles before icing sets.