For me, only the category of "government" is relevant to "us and them".
All other examples given are not personally distinguishing factors. What do I care if someone is or is not a "citizen" - nothing to do with who they are and what they stand for. Those seeking such "black / white" divisions are doing this to stir up misplaced self interest and suspicion in the ranks of the public. This is never to the benefit of the individual.
This goes for gay bashers, jew haters, bible thumpers and those who have been convinced that the Mexicans are coming for their jerbs. The sole objective of the morality police: divide and rule.
Government on the other hand; these individuals purport to exercise power over me. The existence of these officials interferes with my right to govern myself according to my own beliefs, while respecting the right of others to do the same. You better believe I see that as "us" and "them".
As for the rest of the categories - I don't consider them in terms of us and them. However, I ought to qualify that:
Other nations - as long as they do not invade
Gays - as long as they respect my right to choose my own sexual partners
Poor - as long as they do not conspire en masse to rob me of my wealth
Other faiths - as long as their book does not tell them I am life unworthy of life as an infidel and they are to convert / kill me and they act on this
If any of the above happens, it is interfering with my rights again by force...and we're straight back to "government".