Investors have their doubts after the chairman’s appearances jolted markets over the last few months