The housing market downturn is about more than interest rates