The cafe was called 'racist' by some who believed English speakers would be kicked out.