This may or may not be the case, as people's experiences rarely map neatly on top of each other, but usually when I perceive others as being too cool to associate with "the peasants", it's usually more of an insecurity on my side than an aura of elitism from the person in question. In my mind, the thought is "they're too cool to hang out with me", not "they think they're hot shit".