holy crap! the best COFFEE!!!

You might be scalding the 'normal' milk, that'll lead to a sour taste. If your coffee is as hot as mine tends to be it can chemically alter the milk in unpleasant ways.

Jeff