I was selling RE in 1982 and well remember those high rates. I remember one sale to a military couple. Their VA loan had a rate of 14%. Not only that, but there were about 7 points (1pt=1% of loan). The lenders came up with all sorts of fees and points to make up the difference. All you were doing is discounting the cash flow with money (points) up front to make up the difference in interest. This was also about the time we were told in a meeting that the 30 year fixed rate was history, this is also when lenders added "non-assumable" clauses.
John is right on about affordability. Very few people have the wherewithall to pay cash for a house. I think there is pretty high premium in housing prices directly related to low int rates. As an appraiser I've even had the BUYER making the case for a higher (and unsupported, btw) value so they could get there loan. It's all about "how much down and how much are my payments" mentality.