The Prime Minister has been urged to make a major change