The brother of a woman who was stabbed and her son punched in a random attack in Melbourne's CBD says people are worried about violent crime in the city.