Hated is probably too strong a word and I think this analogy could apply to a lot of -isms, but the basic idea probably has some truth to it. Pew did a survey about how warm people's feeling are towards other groups.
http://www.pewforum.org/2014/07/16/how-americans-feel-about-religious-groups/
0 is cold and negative as possible, 100 is warm and positive as possible, and 50 means you don't feel particularly positive or negative towards that group. Atheists get a cool reception, but the range for the averages was 40-63, which is not as bad as I would have expected.