Preheat oven to 350.
In a medium bowl combine cake mix, pudding mix, eggs and oil and beat until smooth.
Spray mini muffin pan and fill each tin half way (NOTE: Batter should be pretty thick). Bake for 12 minutes.
To make glaze beat together powdered sugar, lemon juice and milk. Add more milk if you'd like a thinner consistency.
While muffins are still warm, dip cupcake tops into the glaze and set on wax paper.
Let set completely before storing.