The Treasury minister who thought the housing crash was a joking matter