Inaccurate election polls down to '˜unrepresentative samples'

Labour leader Ed Miliband, Plaid Cymru leader Leanne Wood, First Minister Nicola Sturgeon and Prime Minister David Cameron during an election TV debate. Picture: ITVLabour leader Ed Miliband, Plaid Cymru leader Leanne Wood, First Minister Nicola Sturgeon and Prime Minister David Cameron during an election TV debate. Picture: ITV
Labour leader Ed Miliband, Plaid Cymru leader Leanne Wood, First Minister Nicola Sturgeon and Prime Minister David Cameron during an election TV debate. Picture: ITV
THE failure of opinion polls to predict the result of last year's general election was due to unrepresentative polling samples, an inquiry has found.

And the inquiry said it could not rule out the possibility of “herding” caused by pollsters designing their surveys and weighting responses in such a way that their results were closely in line with those of rival organisations.

The independent inquiry, chaired by Southampton University professor of research methodology Patrick Sturgis, was commissioned by the British Polling Council (BPC) and the Market Research Society (MRS) after polls suggesting a neck-and-neck race were confounded by the Conservatives’ comfortable 6.5% victory margin on May 7.

Hide Ad
Hide Ad

Some Labour supporters claim that inaccurate polling could have swayed the result of the election, by ensuring that attention was focused on the possibility of a Labour coalition with the Scottish National Party, rather than the agenda of a Conservative-only government.

Picture: PAPicture: PA
Picture: PA

Prof Sturgis’s findings chime with a separate study released last week by polling expert Professor John Curtice, which concluded that sampling methods may have resulted in too many Labour supporters being questioned.

The inquiry’s preliminary report, being launched at the Royal Statistical Society in London, has found that unrepresentative samples were the “primary” cause of the polls’ inaccuracy.

Methods of sample recruitment used by the polling organisations resulted in “systematic over-representation of Labour voters and under-representation of Conservative voters”, which was not adequately mitigated through weighting of responses.

Hide Ad
Hide Ad

Other potential issues, such as misreporting of voter turnout, question wording or the treatment of overseas voters, postal voters and unregistered voters were likely to have made “at most a modest contribution” to skewing results.

Picture: PAPicture: PA
Picture: PA

Evidence of a late swing to the Tories was inconsistent, with some polls finding evidence of voters changing their minds at the last minute, while others did not. But researchers found that this would anyway have accounted for at most “a small amount of the total polling error”.

Prof Sturgis said: “There have been many theories and speculations about what went wrong in 2015 but, having considered the available evidence, the inquiry panel has concluded that the ways in which polling samples are constructed was the primary cause of the polling miss.”

Hide Ad
Hide Ad

He said that the lack of variation in Labour and Conservative vote shares in polls over the course of the campaign was “surprising”.

The inquiry was “unable to rule out the possibility that ‘herding’ - whereby pollsters made design decisions that caused their polls to vary less than expected given their sample sizes - played a part in forming the statistical consensus”. But he stressed that evidence of herding behaviour need not imply malpractice by pollsters.

The inquiry will make recommendations to the BPC and MRS when it publishes its final report in March.

Related topics:
Dare to be Honest
Follow us
©National World Publishing Ltd. All rights reserved.Cookie SettingsTerms and ConditionsPrivacy notice