Harvey Norman has blamed the federal budget for softening consumer confidence, with three rate hikes and fuel costs compounding pressure on its sales.