Ah, but see there, your willingness to use violence to enact your liberties gives pause to others who might infringe upon you. You might also identify such a mindset in your fellows. So in all interactions a subtle measure of risk/reward plays out, and if the risk outweighs the reward, then your right is granted.

"Should I grant this stranger a measure of personal space even though I don't know him or know if he's ready to die for such a right he might not care about? Am I prepared to fight to the death over it? If I were to deny him this thing he hasn't asked for, what are the odds he might defend it with his life? How much do I value that space around his body?" Such thoughts are not beyond engagement, regardless of how extreme it all sounds to a civilized man. These are the things that make the foundations of civility - it's merely that today's civil man has forgotten the foundations laid by his forefathers.

Things would be simpler if we were all a little more barbaric. But I still aim for peace and comfort even if my blood must spill on the way.