The poorest people in the U.S. face the most acute shortage of affordable homes.