Is Cameron bringing down the Tory poll numbers?