Video footage showed protesters facing up to police and shouting ‘stop the boats’ on Sunday evening