Police allege the man sexually assaulted five girls, some of them at a north Brisbane bakery where he worked, from the early 1970s into the late 1980s.