Sheriffs are the most proper American type of law enforcement. In almost every state sheriffs answer to the people directly, not the governor, mayor, city council, etc. In most of these states as well they can only be removed by the people as well.

The problem is sheriffs are generally outnumbered by city-run enforcement by a large margin in populated areas.