Why are people anti-tolerant in the name of tolerance?

French policies aside for a minute, I'm gonna be straight with you here: I have never witnessed prejudice against Catholics tolerated over prejudices against other religions. Never. In fact, I'd go so far as to say the majority of people I have come across in my lifetime have not had an opinion one way or another unless they either were Catholics themselves or had been Catholic in their lifetime.