I think people are wary of citizens carrying guns because citizens sometimes kill people with guns. Even in westerns like Tombstone the sheriff had citizens check their guns when they came into town. If you get pissed off at somebody you might yell at them or maybe even take a swing if you have a bad temper, but if you're packing heat that only increases the chance some nut will go for his gun and kill somebody.