The Birmingham comedian addressed the situation after it was revealed around 20,000 flags are flying across the city and nearby