Rain is already falling in the city and it's set to pour down until tonight