You hit the nail on the head.
The property taxes.
IMO, that's the biggest obstacle...some locales play fair and reduce them along with the assessed values of the properties. Others (strong union states), play with the "multiplier" and make certain that your tax bill keeps rising, no...