Microsoft PowerPoint - the NCRM EPrints Repository

advertisement

2010: Did online polling come of age?

Anthony Wells – Associate Director

Joe Twyman - Director of Political Research, YouGov

2

The history of online polling

YouGov founded in 2000

YouGov conducted 2 polls for the 2001 general election for the Sunday

Business

By 2005, YouGov was the regular pollster for the Daily Telegraph and

Sunday Times. Also carried out fieldwork for the British Election Study and BPIX polls for the Mail on Sunday. Harris Interactive carried out 2 polls independently and press released during the campaign

3

How online polling works (the YouGov model)

Sampling

From a panel of paid volunteers. Proactively recruited to try and be representative of all groups in society, but not necessarily representative as a whole.

Closer to quota sampling than random sampling (email invitations go out to random selections from various demographic groups)

Since 2010, YouGov has moved to more dynamic sampling to allow daily polling

Use of online panel means some areas are obviously NOT suitable for online polling. E.g. attitudes to taking up broadband or openness to new technology.

Respondents get paid 50p (not too high or too low)

Panellists not polled too frequent

4

How online polling works (the YouGov model)

Weighting

Rim weighted to standard demographics (age, region, gender, social class), plus party identification and newspaper readership (mainly to get the broadsheet v tabloid split right)

Important difference between online panel surveys and telephone surveys is WHEN the data is collected

Online panels collect demographic data when people register, store it, then use it to weight future surveys. Telephone surveys need to collect demographic data in the same survey

 This mostly removes the problem of evolving false recall (or in YouGov’s case, party ID)

No spiral of silence adjustment or similar – lack of human interviewer should reduce any embarrassment factor

5

In 2010, online pollsters outnumbered telephone pollsters

Large number of new entrants, mainly online

Regular campaign pollsters 2005 Regular campaign pollsters 2010

6

Why was there an influx of online pollsters?

 YouGov’s track record had established online polling as a respectable method.

Low cost

Low barriers to entry – no need for a field force, availability of panel providers

No geographical constraints

7

The impact of online polling in 2010

Daily Polling

There were two major innovations in political polling in the 2010 election.

Polling online was a major factor in both.

1 ) Daily Polling

Had been attempted previously using “rolly-polls”, with some problems.

YouGov did genuine daily polls with discrete samples of 1,400 a day.

Feasible because of the low cost and rapid turnaround of online polling.

8

40

35

30

25

20

15

10

5

The Campaign

YouGov Daily Polling Results

45

Labour Conservative Lib Dem Other

9

The impact of online polling in 2010

Post debate polling

There were two major innovations in political polling in the 2010 election.

Polling online was a major factor in both.

2) Post-debate polling

Reliant upon panel technique and extremely rapid turnaround.

Not necessarily online (ComRes used automated telephone) but YouGov,

Populus and Angus Reid all online.

ICM, using traditional telephone, was slower.

10

Final Predictions

Telephone polls did better than online polls

Con Lab LD Oth

ICM

Populus

Harris

Ipsos MORI

YouGov

ComRes

Opinium

Angus Reid

TNS BMRB

RESULT

36 28 26 10

37 28 27 8

35 29 27 9

36 29 27 8

35 28 28 9

37 28 28 7

35 27 26 12

36 24 29 11

33 27 29 11

37 30 24 10

Con

Lead

+7

+9

+8

+12

+6

+8

+9

+6

+7

+7

Average error

1.25

1.75

1.75

1.75

2.25

2.25

2.25

3.25

3.25

11

Final Predictions

…but this may just be established companies doing better than new ones

Con Lab LD Oth

Con

Lead

Average error

ICM

Populus

Harris

Ipsos MORI

YouGov

ComRes

Opinium

Angus Reid

TNS BMRB

RESULT

36 28 26 10

37 28 27 8

35 29 27 9

36 29 27 8

35 28 28 9

37 28 28 7

35 27 26 12

36 24 29 11

33 27 29 11

37 30 24 10

+7

+9

+8

+12

+6

+8

+9

+6

+7

+7

1.25

1.75

1.75

1.75

2.25

2.25

2.25

3.25

3.25

12

The future of online polling 1

 Online polling isn’t easy, and there were some comparative poor results from the new online companies.

How many will stick around? There have been Angus Reid, Harris and

OnePoll surveys since the election (though not Opinium), but none have a continuing regular contract.

Growing competition to recruit panellists and challenges of recruiting and maintaining high quality panel

13

The future of online polling 2

Growing problems with telephone polling from dropping response rates and the move from landlines to mobile only households. The existing phone model needs to adapt and change anyway.

Growing internet penetration

While new online companies did not have the greatest 2010 election, it is

MUCH easier the second time around – companies like Angus Reid and

Harris will now have baseline election data on their panels.

Move to online polling may end up being more pronounced amongst the established companies, rather than newcomers. Since the election

ComRes are doing parallel online VI polls and Populus have done some political polling online. ICM and Ipsos-MORI do online polling, but not yet for mainstream political polling.

Joe.Twyman@YouGov.com

Anthony.Wells@YouGov.com

Download