Anthony Wells – Associate Director
Joe Twyman - Director of Political Research, YouGov
2
The history of online polling
YouGov founded in 2000
YouGov conducted 2 polls for the 2001 general election for the Sunday
Business
By 2005, YouGov was the regular pollster for the Daily Telegraph and
Sunday Times. Also carried out fieldwork for the British Election Study and BPIX polls for the Mail on Sunday. Harris Interactive carried out 2 polls independently and press released during the campaign
3
How online polling works (the YouGov model)
Sampling
From a panel of paid volunteers. Proactively recruited to try and be representative of all groups in society, but not necessarily representative as a whole.
Closer to quota sampling than random sampling (email invitations go out to random selections from various demographic groups)
Since 2010, YouGov has moved to more dynamic sampling to allow daily polling
Use of online panel means some areas are obviously NOT suitable for online polling. E.g. attitudes to taking up broadband or openness to new technology.
Respondents get paid 50p (not too high or too low)
Panellists not polled too frequent
4
How online polling works (the YouGov model)
Weighting
Rim weighted to standard demographics (age, region, gender, social class), plus party identification and newspaper readership (mainly to get the broadsheet v tabloid split right)
Important difference between online panel surveys and telephone surveys is WHEN the data is collected
Online panels collect demographic data when people register, store it, then use it to weight future surveys. Telephone surveys need to collect demographic data in the same survey
This mostly removes the problem of evolving false recall (or in YouGov’s case, party ID)
No spiral of silence adjustment or similar – lack of human interviewer should reduce any embarrassment factor
5
In 2010, online pollsters outnumbered telephone pollsters
Large number of new entrants, mainly online
Regular campaign pollsters 2005 Regular campaign pollsters 2010
6
Why was there an influx of online pollsters?
YouGov’s track record had established online polling as a respectable method.
Low cost
Low barriers to entry – no need for a field force, availability of panel providers
No geographical constraints
7
The impact of online polling in 2010
Daily Polling
There were two major innovations in political polling in the 2010 election.
Polling online was a major factor in both.
1 ) Daily Polling
Had been attempted previously using “rolly-polls”, with some problems.
YouGov did genuine daily polls with discrete samples of 1,400 a day.
Feasible because of the low cost and rapid turnaround of online polling.
8
40
35
30
25
20
15
10
5
The Campaign
YouGov Daily Polling Results
45
Labour Conservative Lib Dem Other
9
The impact of online polling in 2010
Post debate polling
There were two major innovations in political polling in the 2010 election.
Polling online was a major factor in both.
2) Post-debate polling
Reliant upon panel technique and extremely rapid turnaround.
Not necessarily online (ComRes used automated telephone) but YouGov,
Populus and Angus Reid all online.
ICM, using traditional telephone, was slower.
10
Final Predictions
Telephone polls did better than online polls
Con Lab LD Oth
ICM
Populus
Harris
Ipsos MORI
YouGov
ComRes
Opinium
Angus Reid
TNS BMRB
RESULT
36 28 26 10
37 28 27 8
35 29 27 9
36 29 27 8
35 28 28 9
37 28 28 7
35 27 26 12
36 24 29 11
33 27 29 11
37 30 24 10
Con
Lead
+7
+9
+8
+12
+6
+8
+9
+6
+7
+7
Average error
1.25
1.75
1.75
1.75
2.25
2.25
2.25
3.25
3.25
11
Final Predictions
…but this may just be established companies doing better than new ones
Con Lab LD Oth
Con
Lead
Average error
ICM
Populus
Harris
Ipsos MORI
YouGov
ComRes
Opinium
Angus Reid
TNS BMRB
RESULT
36 28 26 10
37 28 27 8
35 29 27 9
36 29 27 8
35 28 28 9
37 28 28 7
35 27 26 12
36 24 29 11
33 27 29 11
37 30 24 10
+7
+9
+8
+12
+6
+8
+9
+6
+7
+7
1.25
1.75
1.75
1.75
2.25
2.25
2.25
3.25
3.25
12
The future of online polling 1
Online polling isn’t easy, and there were some comparative poor results from the new online companies.
How many will stick around? There have been Angus Reid, Harris and
OnePoll surveys since the election (though not Opinium), but none have a continuing regular contract.
Growing competition to recruit panellists and challenges of recruiting and maintaining high quality panel
13
The future of online polling 2
Growing problems with telephone polling from dropping response rates and the move from landlines to mobile only households. The existing phone model needs to adapt and change anyway.
Growing internet penetration
While new online companies did not have the greatest 2010 election, it is
MUCH easier the second time around – companies like Angus Reid and
Harris will now have baseline election data on their panels.
Move to online polling may end up being more pronounced amongst the established companies, rather than newcomers. Since the election
ComRes are doing parallel online VI polls and Populus have done some political polling online. ICM and Ipsos-MORI do online polling, but not yet for mainstream political polling.