The Work and Pensions Committee has warned the change will hit some people much harder than others