Ornate panels around public toilets at St Vincent Place have been smashed “to pieces” despite an order to retain them.