Doesn't this argument pre-suppose that we all abide by their idea of tolerance and then use that as evidence for itself?
Yes.