The victims included two police officers in the collision near Middlesbrough, as the police watchdog opens an investigation.