Locals and tourists alike have lamented the loss of the historic site