My grandfather got undulant fever, AKA brucellosis from drinking raw milk, and was a very sick man. When they gave him penicillin, which was new, and just in experimental stages at that time, he had an allergic reaction which almost killed him.
On the other hand, my dad drank raw milk from their own cows all the time he was growing up, and never got sick.