Prime Minister Anthony Albanese has batted away allegations that a grants program that included a $6 million upgrade to a golf course in his electorate is an example of pork barrelling.