I intend to have a lean muscle built, for which I have been consuming over 200ml of chilled milk daily, apart from other protein sources. But many sources say that milk is a source of fats. So should I continue having milk if I want to build a lean, muscular body(repeated for emphasis) like Hugh Jackman?
Bodybuilders of old drank milk and built great physiques.
Milk is a great source of protein, but whole milk does have a lot of fat. This may not be a problem if you are trying to get maximum calories.
You may want to switch to 2% or skim milk if calories/fat are a concern.

milk is very fattning! drink super or slimmed milk! that is not as bad!
References :
Bodybuilders of old drank milk and built great physiques.
Milk is a great source of protein, but whole milk does have a lot of fat. This may not be a problem if you are trying to get maximum calories.
You may want to switch to 2% or skim milk if calories/fat are a concern.
References :
http://strongandfit.net
Milk has a lot of good fats which help guys bulk up. It has been stated that a lot of bodybuilders drink skim or partly skimmed milk and a lot of it (a gallon) each day to maintain themselves. Milk also has a lot of protein in it, a crucial part of building muscle.
You can use skim milk or even chocolate milk as your recovery drink.
References :