Whisk in cold milk and egg yolks and mix to combine.
Pour this mixture into a medium saucepan over medium heat, stirring constantly until the mixture reaches a boil.
Continue stirring and let boil for 1 minute.
Remove pan from heat and whisk in butter and vanilla until butter is melted.
Stirring occasionally, let the mixture cool, and serve warm or chilled.