The Prime Minister stands by Parliament statement despite apologising for payment errors.