Organisers said that calling off part of the event was "the safest and most responsible decision for everyone"