There is no nutritional reason to heat milk, but most babies prefer it lukewarm. Children usually begin drinking refrigerated drinks like milk, water and juice at 10 to 12 months, but if your child doesn’t like cold milk, you can continue warming it up.