Ryan and Jess knew their family's future would 'lie outside the UK'