The distressed sweater made an unintentional statement and angered Browns fans once again