The dad-of-three from Manchester said he doesn't want distractions 'unless it is something serious'