Competitive pressures on small lenders ease as refinances diminish