'We need to remove the barriers that make visiting the high street harder than it needs to be'