Place the milk and butter in a small bowl and microwave on High until the butter is mostly melted and the milk is warm, 30 to 40 seconds. (Alternatively, place in a small saucepan and heat over medium until the milk is warm.) Stir the milk mixture, sugar, salt and pepper into the mashed potatoes until combined.