VodkapunditVodkapunditVodkapundit
How to Read the Polls
Posted by Stephen Green  ·  16 September 2004

You probably already caught this on Instapundit, but here's what was buried deep in the link:

The Pew poll found the race at 46-46 among registered voters, and 47-46 Bush among likely voters. A Gallup poll being released Friday has Bush up 54-40 in a three-way matchup, with Ralph Nader (news - web sites) at 3 percent.

Big discrepencies like that one are why I like to stick to tracking polls, like Rasmussen. Forget the registered voters data -- that's always off. But even among likely voters, Pew shows a one-point race. Gallup has a 14-point spread. Obviously, one of these guys (if not both) is wrong.

Tracking polls are different. They publish every day, not once a week or a month. While they may suffer from some bad methodology (all polls do, period), they still allow you to see the broader trend. Because whatever bias a tracking poll has (again, all polls are biased), it tends to even out in the wash.

Perfect? Hardly. But probably the best thing going -- even though all they can show you reliably isn't hard numbers, but, once again, the broader trend.

When Pew shows a one-point race, I'm more likely to beleive that than I am Gallup's big blow-out. But each poll is flawed, in that it tries to take a snapshot of a moving image. If you know anything about photography, you know that when you take pictures of runners, you usually end up with either a blurred background or a blurred subject. And if your shutter speed is fast enough to capture everything clearly, then you've captured such a brief moment in time that the photo reveals little about the race.

Tracking polls attempt to take a movie of a race. They can't show the finish line, but you get a better idea of the back and forth between the runners -- er, candidates.

Rasmussen has a pretty good track record (no pun intended), and they show a pretty close race. But the broader trend is that Bush's convention bounce, once fading, looks to be gathering some CBS-generated steam.

With less than seven weeks to go, the trend is against Kerry. That can change overnight. But the closer we get to November 2, the fewer chances Kerry gets to reverse the trend, and the harder he'll have to try.

Expect some big fireworks - duh.

Comments

Would the Kerry campaign, the rest of the Dems, and their shills in the MSM be acting as crazy as they have since the convention if the race was tied a la Pew or even if Bush was up 3-4 a la Rasm'n?

They're acting like they're down big-time, to reference Cheney.

It may not be 14, but I think must be at least 9-10.

Posted by: Jim in Chicago at September 16, 2004 11:23 PM

For some reason this doesn't sound right to me... a 12 point swing overnight???

The latest national survey of 1,972 registered voters by the Pew Research Center for the People & the Press, conducted in two waves over a seven-day period, finds that the president's large margin of support in the initial period (Sept. 8-10) dissipated in the polling conducted Sept. 11-14. Among all registered voters Bush initially led Kerry by 52%-40%. However, the second wave of interviewing shows the race even among registered voters, at 46%-46%. When the sample is narrowed to likely voters, Bush holds a statistically insignificant lead of 47%-46% in the second wave, down from a huge 54%-38% advantage he held in the first wave of interviews.

http://people-press.org/reports/display.php3?ReportID=224

Posted by: Efrain at September 17, 2004 12:20 AM

Sorry thats 6 points... I need a drink.

Posted by: Efrain at September 17, 2004 12:21 AM

Efrain,

Now do you see why I stick with the tracking polls?

Posted by: Stephen Green at September 17, 2004 12:24 AM

Stephen,

Whenever I've discussed poll tracking with people I've always described them as an extension of the Heisenberg Uncertainty Principle. I may have to adopt your photography analogy, I'd be sure to get a lot fewer blank stares.

Michael

Posted by: Michael at September 17, 2004 12:34 AM

Ever notice how when Bush is doing well, violence picks up in Iraq.

Posted by: aaron at September 17, 2004 03:31 AM

Aaron, I think you mean, that the MSM steps up the Henny Penny, the sky is falling news articles.

Posted by: erp at September 17, 2004 05:40 AM

I would think that after the learning experience many had in 2000--Gore won the popular vote; Bush won the Electoral College--that following any national poll, tracking or otherwise, would be dangerous when trying to predict the Presidential race. [Note to self: Gotta work on those run-on sentences.]

Posted by: azlibertarian at September 17, 2004 06:53 AM

I did a quick little linear regression going back to 1936 on Gallup's poll numbers midway through September.

The best fit line to the incumbent party's share of the two-way popular vote is:

y = .613x + .212

Where y = the eventual incumbent party's share in the two-way popular vote and x = the incumbent party's share in the two-way Gallup numbers.

There's a relatively high correlation between Gallup's mid september numbers and the actual result (correlation coefficient = .79). What that means for non-math folks is that historically Gallup's numbers have been a fairly good indicator of the actual results.

Bush's predicted final popular vote share of the two-party vote is 56%. Only twice in the 17 years has the difference between the prediction and the actual results been large enough to overturn that lead (1980 when Carter was ahead and Reagan wound up winning easily and 1936 when Roosevelt was ahead and eventually won in a huge landslide). Other than those two, the line fits fairly well.

That is to say, if Gallup's historical accuracy holds, this is very good news for Bush.

Posted by: Mr Vee at September 17, 2004 07:03 AM

AZlibertarian,

People keep saying this but it wasn't like Gore ran away with the popular vote. He "won" it in the sense that he had more votes but it was 50.3% to 49.7% of the two-way vote. A virtual tie.

If either candidate gets 53% of the two-way vote, they're going to win pure and simple. If either gets 52% of the two-way vote, they likely win.

Only when the popular vote is very, very close would you expect the electoral to shift opposite of popular.

Posted by: Mr Vee at September 17, 2004 07:10 AM

Steve,
You make good points about tracking polls -- but even a poll that shows someone ahead 49-45 with 5-6% undecided, when you factor in the margin of error -- then you can have ANY result.

Face it, head-to-head polls are fun, but useless. The key figure from the Gallup survey is that Bush's approval rating is holding at 52% - and that's good. Historically, that means he should win with something like 52-47 or 51-47 (depending how much Nader peels off). As Mr. Vee correctly states, the EV race will not be a contest with popular votes like this.

Posted by: mike the analyst at September 17, 2004 07:22 AM

The Pew poll was done over a weekend - from Saturday to Tuesday.

The Galluo poll was done only on weekdays - from Monday to Weds.

The Pew poll likely had far fewer respondents who were observant religious folks (because they were at synagogue on Saturday and /or church on Sunday)than the Gallup poll did.

In other words: by polling on a weekend Pew likely under-polled a important categpory of voters.

"Religiously observant folks" is a category of voters that OVERWHELMINGLY votes for W.

Therefore: IF relgiously observant folks are in fact likely voters, then the Gallup poll is likely far more accurate.

Posted by: daniel at September 17, 2004 08:31 AM

The problem that I see here is that Pew provided enough information to treat it, to some degree, like a mini-tracking poll. For what is not getting reported but was the case is that the result showing Bush up by just one was only part of the poll.

They actually polled from Sept 8-14th. During the first half of the poll, Bush was up huge. Gallup-like.

During the second half, it was essentially a tie.

Consider it to be two data points from a tracking poll. They showed about 10 points of movement within a handful of days-- movement that the one tracking poll going right now did not see, movement that other polls have not seen. The other polls showing the race tied, showed the race tied before. The other poll (Gallup) showing the race big in Bush's direction, show Bush up big.

So the question I have for you-- do you really think that the race changed 10 points between Sept 8-10, and Sept 11-14?

If you doubt that, then you have to doubt at least part of Pew's results. And which do you doubt? Is there a reason to believe the front part over the last part, or vice-versa?

The overall Pew survey, conducted from Sept 8-14 has Bush up 49-43 among registered voters and up 51-42 among likely voters. Unless someone can give me a really good reason for believing the second half of that survey (where it was a 1 point race) over the first half (where it was a 16 point one), I'll take the whole thing with a grain of salt, but put more stock in the results from the whole survey than just a portion of it.

Posted by: Gerry at September 17, 2004 12:07 PM

Some of the media are breaking ranks, but some of them are sticking it out with CBS. But I think the Kerry campaign has been hurt at the margins. And it is at the margins that this presidential campaign will be won. 0.1% here, 0.1% there, and pretty soon, you're focusing on your concession speech. But I wouldn't get too worked up as yet. The debates are yet to come. Save the bubbly for Nov 5.

Posted by: Zhang_Fei at September 18, 2004 02:37 PM

Pew, like Zogby, adjusts their results to factor in the same percentage of Democrats and Republicans as reflected in the 2000 vote. Party ID is not a demographic since people self-identify and when they support Bush, a portion tends to view themselves as Republicans as well. The effect of this adjustment is to remove Bush supporters, when they have changed parties. I'm surprized that these polls show any Bush lead. Because they do, Kerry is in real trouble.

Posted by: Rick Keseley at September 21, 2004 12:07 PM



Navigation

MDS - Give Until It Hurts

Terror War Scorecard
Watching America

50 Things
American Cancer Ablation Center
Buy VodkaPundit Stuff



VodkaPundit on Amazon
Vodkapundit for PDA (AvantGo)
Vodkapundit for PDA (Not)
VodkaPundit XML or RDF

Search



Advanced Search



Last Call

The Author

"...the Internet version of Playboy After Dark"
-Frank Martin

Absolut Link

Blog-Iran

Top Shelf

Ann Althouse
Baldilocks
Austin Bay
Belmont Club
Tim Blair
Chequer Board
Command Post
Counterterrorism Blog
Day By Day
Daniel Drezner
From the Bleachers
Hit & Run
INDC Journal
Iraq the Model
James Joyner
James Lileks
Megan McArdle
OPFOR
Protein Wisdom
Glenn Reynolds
Bill Roggio
ScreedBlog
Roger L. Simon
Rob Smith
Steven Taylor
Venomous Kate
Matt Welch
Winds of Change
Michael Yon
Yuppies of Zion


The Usual

Across the Atlantic
Anticipatory Retaliation
Atlas Shrugs
The Black Republican
Blogcritics
Captain's Quarters
Phil Carter
The Daily Ablution
Andrew Ian Dodge
Eye on the Left
Mike Hendrix
In From the Cold
Charles Johnson
Kathy Kinsley
A Likely Story
Brian Linse
Jay Manifold
Neocon News
Frank Martin
QandO
Bill Quick
Rantburg
John Scalzi
Sine Qua Non Pundit
Team Stryker
Mac Thomason
Michael Totten
Jesse Walker
Dr. Weevil
Bill Whittle
Chief Wiggles
Sissy Willis
Cathy Young

Micro Brews

American Realpolitik
Black Five
Boots and Sabers
Capitalist Lion
Scott Chaffin
John Cole
Coming Anarchy
Bo Cowgill
Dr. Frank's Blogs of War
Donklephant
Ed Driscoll
Kim du Toit
Glenn Frazier
Joe Gandleman
The Gay Patriot
Godless Capitalist
Bill Hobbs
John Hudock
Frank J.'s IMAO
Joanne Jacobs
Brothers Judd
Junk Yard Blog
Major John
Davids Medienkritik
Mr. Misha's Rottweiler
Only Baseball Matters
Matt Moore
Jack O'Toole
Peaktalk
Eric S. Raymond
Red Sugar
Resurrection Song
Robin Roberts
Andrea See
Mathew Sheren
Spoons Experience
DC Thornton
Yankee Station

Gin & Tonic

Albion's Seedlings
American Digest
Radley Balko
Paul Berger
Robert Bidinotto
Blogometer
BusinessPundit
The Chicago Boyz
Classical Values
Conrad the Expat
Susanna Cornett
Dave Cullen
England's Sword
Dean Esmay
Horsefeathers
Jessica's Well
Alex Knapp
Legal Spin
Light of Reason
The Lipstick Republican
Moxie
OxBlog
Suman Palit
Punch the Bag
The Pursuit of Happiness
Samizdata
Sofia Sideshow
Natalie Solent
Texas Best Grok
Professor Michael Tinkler
Cal Ulmann
Brothers Volokh

Cosmopolitans

Justene Adamec
Stephen Bainbridge
La Shawn Barber
Moira Breen
Sasha Castel
Colorado Psycho
Clayton Cramer
CrossingWallStreet
Martin Devon
Kevin Drum
Henry Hanks
Diana Hsieh
Jeff Jarvis
Jessica
Sean Kirby
Liberty Belles
Rachel Lucas
Jeralyn Merritt
Philip Murphy
Oasis of Sanity
Andrew Olmsted
Walter Olson
Michael Parker
Popped Culture
Porphyrogenitus
Fritz Schrank
Donald Sensing
Elizabeth Spiers
The Swanky Conservative
Two Blowhards
Michael Ubaldi
Alexandra von Maltzan
Will Wilkinson

Rum & Coke

The Argument Clinic
Below the Beltway
The Bitch Girls
Jay Caruso
Dog's Life
Fire On The Mountain
GeckoBlue
GZ Expat
David Hogberg
John Hawkins
Horologium
Kris Lofgren
Floyd McWilliams
John Moore
PhotoDude
Robyn Pollman
Chas Rich
Silflay Hraka
Geitner Simmons
Skippy
Dave Tepper
Transterrestrial Musings
Trying to Grok
Walter in Denver
Don Watkins
Weekend Pundit
Joshua Zader

Tequila Shots

Todd A
N.Z. Bear
Begging to Differ
David MSC
Gary Farber
Highered Intelligence
Isntapundit
Jonathan and Wanda
Ken Layne
Nick Marsala
Dan Michalski
Sheila O'Malley
Dawn Olsen
Tony Pierce
Raving Atheist
Matt Traylor
Sekimori
WMET Blog
World Wide Rant

Manischewitz

Moe Freedman
Tal G. in Jerusalem
IsraPundit
Kesher Talk
Mike Silverman
Allison Kaplan Sommer
Meryl Yourish

Boozehounds

Allah Is In the House
Dave Barry's Blog
The Daily Sedative
Doug Dever
Daniel Frank
Scott Ott
Large American Penis
Short Strange Trip
Ten Fingers, Six Strings
Jim Treacher

Cyanide-Laced Kool-Aid

Laurence Simon

Sex on the Beach

Body in Mind
ErosBlog
Eroticalee
Just One Bite
Fred Lapides
New York Hotties
SLA
Unablogger

Kegger

Ben Domenech
HokiePundit
Hoosier Review
John Tabin
Nicholas West

Fosters

Duck Season
Mike Jericho
John Ray
Bernard Slattery
Whacking Day

Molson

Banana Counting Monkey
Daimnation!
Dispatches
David Janes
Western Standard

Left Wing Bar Nuts

Ted Barlow
Joshua Marshall
Dan Perkins

Cover Charge

Eric Alterman
Dave Barry
Barone Blog
Austin Bay
Jay Bryant
C-Log
Campaign Desk
Steve Chapman
Dallas News Blog
Matt Drudge
Google News
Nat Henthoff
Hugh Hewitt
Mickey Kaus
Howard Kurtz
National Review Online
The New Republic
The New York Times
Newsweek
OpinionJournal
Kathleen Parker
Daniel Pipes
Virginia Postrel
Roll Call
Larry Sabato
Linda Seebach
Slate
Sploid
Mark Steyn
StrategyPage
Andrew Sullivan
Tapped
Tech Central Station
Time
US News & World Report
David Warren
The Washington Post

Under the Table

American Times
Angry Left
Asparagirl
BitchPundit
John Braue
Shiloh Bucher
Carthaginian Peace
Lorenzo Cortes
Steven Den Beste
Fevered Rants
Scott "Funkadelic" Ganz
Juan Gato
Happy Fun Pundit
Andrea Harris
Scott Koenig
Brink Lindsey
Sue Lizano
Kieran Lyons
Mean Mr. Mustard
Meeshness
Punditwatch
Dennis Rogers
Jim Ryan
Spinsanity
Unremitting Verse
Norah Vincent
Tony Woodlief

Archives

Powered by Movable TypeDesign by Sekimori