Maybe the deal at Alexandria is that weaker people get exiled. Those 2 dudes on the patrol with Rick are in the habit of acting badass so they don't get cut. Maybe it's a dichotomy where you have to be civil inside but badass enough to defend the community from the outside and politely maintain control inside.

And maybe it's like Saban's football roster with a limited population where they always look for better people and cut the weaker ones.