Hundreds of homes are set to be built on the site