Lobbyist Jeremy Greenwood said a right-wing Liberal Party factional group at the centre of a corruption watchdog inquiry became so "toxic" he encouraged his friends to leave it.