A controversial statue honouring a divisive former premier has been scrapped by a new leader months before a state election.