I used to raise dairy goats for fun and profit.
The milk can really range in taste. Nubian is really heavy on the butterfat and is sweet. Milk from the swiss Toggenberg types is more bitter, usually, but less fat. We usually blended ours.
But in general, goats milk is a lot better for you than cows milk. When my son was born, and we needed to start supplementing breast milk with formula, (I forget why, my wife was on medication or something) we couldn't find one he was not violently allergic to. Even the really expensive hypo-allergenic weird crap. No soy, nothin worked.
So I went to a friend who was still raising goats and got some goats milk and pasteurized it, and it worked like magic.
I used to drink a half-gallon of the stuff a day, maybe more, back in high school.
Can't beat it!