They have that right, btw, because there are agreements with almost all other countries. If you move to a rogue nation, they'd have a harder time freezing your assets - unless you ever wire money anywhere, that is. They'll seize the wire.
But then....you'd be living in Caracas under Chavez...