Michael Gove looks rattled by a bruising couple of weeks