Last summer, there was an eruption of concern among schools that the GCSE English exam had suddenly been made harder by a change in grade boundaries. Ofqual, the exams regulator whose job it is to keep exams equally easy in all years, certainly intervened: what is not clear is if it got it right, or whether it made it too difficult.
A judge is considering whether the boundary-setting was conducted via a fair process. But we now have some data with which to look at the issue from the National Pupil Database. I have GCSE English (or English language) results and each candidate’s scores at the age of 11 (although not which exam they took, nor their exam board*).
Since the aim of boundary-setting is to keep exams equally difficult, and since Ofqual believes the school system has not improved, we can use these two results together to tell us something: similarly able children at the age of 11 should get roughly the same grade in 2011 and 2012. There are horribly complex ways to do this formally, but I am going for an intuitive method. Read more
Today’s UCAS statistics are pretty grim: the number of people applying to UK universities is falling, and the drops are big. A 6 per cent fall in applications since last year is a big deal.
At the same stage last year, 321,908 people had applied for places. This year, it is 303,861. At the 2011 peak, it was 344,064. These are preliminary results: lots of students are still weighing their options and will apply in the coming months, but it is a big fall. Read more
At the moment, the Department for Education is considering changes to the league tables and the exam system. This seems an opportune moment to make a simple point about qualification-awarding and accountability: English school examinations are subject to measurement error in a really big way.
Here is a simple thought experiment to flesh it out. Imagine a class of 100 students. Let us specify that each one has a “true” ability that means that one pupil should get one point, one pupil should get two, one should get three and so on – up to 100 marks. Now, let’s award this class one of 10 grades: 90+ gets you an A, 80+ a B and so on.
Let us assume that the tests are perfect. If that were the case, you would get ten individuals in each grade. Easy enough. But what happens if we start introducing errors into the test? We can do that with a set of exotically named (but very simple) “Monte Carlo” estimates, which I calculated using this simple spreadsheet. Read more
Last week, I went to Wolverhampton where I spoke at a local debate, organised by the university and Pat McFadden, the local MP, about the local authority’s school. I was the warm-up act for Lord Adonis, former schools minister, setting the scene about the city’s education system before his talk on lessons on school improvement.
It was interesting event – and the city is clearly considering its future and the role of education within it. There is – judging by my inbox – serious and deep interest in improving schools in the city. One of the things I sought to do was set out Wolvo’s position in relation to the rest of the country – and what statistics about the city tell us.
Here is my presentation: Read more
Fraser Nelson, editor of the Spectator, has written up a paper on Swedish school reforms, which you can download here. I thought it was worth using to quickly flag up two important statistical public policy points.
The context to this is that Sweden has, since the early 1990s, allowed private (including for-profit) institutions to enter the school system – and parallels are often drawn between it and the ongoing reforms of England’s school system. This paper, as Fraser rightly says, comes to the view that increasing the volume of private schools in an area is associated with improved results. Mikael Lindahl and Anders Böhlmark say:
If we transform our estimates to standard deviation (S.D.) units (using the variation across all individuals) we find that a 10 percentage point increase in the share of independent-school students has resulted in 0.07 S.D. higher average educational achievement at the end of compulsory school.