I've certainly been called an elitist in the past, and I've accepted the label gladly. I was, after all, a BBS warez d00d when I was 15.
Today, though? Today I do not. We do not ask for government by the "best", the smartest, or the most educated. We ask only conformance to the barest minimum of social standard.
I don't need the President to be the "best". I ask only that the President be a person I can hold a five minute long civil conversation with on some issue of national importance. That is not "elitism".