Campaigners for integrated education in Northern Ireland have “lost their way”, Education Minister Paul Givan has said.