'This shift would not only strip me of my livelihood but also rob our community of a cherished gathering spot,' the owner said