Angry David Miliband leaves Manchester for London