Analysis: The hard truth about fact-checking

WASHINGTON Tue Oct 16, 2012 1:02am EDT

Two chairs that will be used by U.S. President Barack Obama and Republican presidential nominee Mitt Romney sit empty during preparations for Tuesday's presidential debate at Hofstra University in Hempstead, New York, October 15, 2012. REUTERS/Lucas Jackson

Two chairs that will be used by U.S. President Barack Obama and Republican presidential nominee Mitt Romney sit empty during preparations for Tuesday's presidential debate at Hofstra University in Hempstead, New York, October 15, 2012.

Credit: Reuters/Lucas Jackson

Related Topics

WASHINGTON (Reuters) - Fact-checking presidential campaigns has become a kind of sport in recent years, complete with scorecards tallying the competition between ratings of true, false or somewhere in between.

What has been missing - and is likely to stay missing in Tuesday's presidential debate - is suspense. The winner in the ratings game is generally the same: somewhere in between.

The terminology differs from fact-checker to fact-checker. But the reality is that the vast majority of claims fact-checkers put under scrutiny are deemed to be partly true or partly false but rarely completely one or the other.

The triumph of the neither wholly true nor wholly false partly reflects the complexity of the issues. But credit mostly goes to obfuscation by the campaigns.

Theirs is a world of apples-to-oranges comparisons and cherry-picked time frames, enveloped by a fog of competing studies.

As PolitiFact.com and other fact-checkers have noted, for example, the increase in the federal budget deficit cited by the campaigns depends entirely on the starting point for the calculation.

It's bad for President Barack Obama if the starting point for the calculation is fiscal 2008, which ended before Obama took office and is the reference point for the campaign of Republican candidate Mitt Romney.

But it's not quite as bad if the starting point is January 2009, when he actually assumed office.

"There is most often some grain of truth - sometimes very difficult to discern - but the candidates will twist it and distort it," said Brooks Jackson, a veteran journalist who runs FactCheck.org.

When all is said and done, the Romney claim that Obama has "doubled the deficit" may be all the voter can absorb.

The same is true for claim by Obama's campaign that a Medicare reform plan by Republican vice presidential candidate Paul Ryan would cost the elderly more than $6,000 per year.

True or false? PolitiFact.com could only muster a 50-50 judgment.

The problem is this: There are at least four iterations of a "Medicare plan" associated with Ryan. The Obama campaign had the opportunity to cherry-pick one and took it, choosing the version that could be portrayed as the most threatening thanks in part to a study by the Congressional Budget Office.

There was no simple answer, so fact-checkers resorted to long analyses on whether the claim was plausible.

"There is a number (behind the claim) and it's not made out of whole cloth, but it's used in a misleading manner," said Glenn Kessler, a fact-checker at The Washington Post.

The final judgment at PolitiFact.com required 1,200 words including footnotes. At FactCheck.org it was 1,000 words.

That makes them treatises by journalistic standards, unlikely reading for all but the most determined voters.

FOUR PINOCCHIOS

True or false is reserved for the laughable claim or something empirically disprovable.

Romney told crowds in December and February that Americans were the only people in the world to hold their hands over their hearts while their national anthems were played.

Kessler and other fact-checkers found numerous examples to the contrary.

And it was easy to establish that Obama was not in New York City the same day as Israeli Prime Minister Benjamin Netanyahu, a claim that Ryan made in an effort to show that Obama snubbed the Israeli leader by not meeting him there.

To make things easier for readers, Kessler grades claims on a scale of one-to-four Pinocchios. He said that both Obama and Romney were averaging just above two Pinocchios, the rating for claims marked by "significant omissions and/or exaggerations" but not necessarily factually erroneous.

FactCheck.org uses a graphic "truth-o-meter."

Neither can capture the complexity of such questions as whether Romney's tax plan is "mathematically impossible," as the Obama campaign says, citing a study.

While fact-checking is undoubtedly good for democracy, arguments in the press over unsupported or outlandish claims tend to spread them, not debunk them, as research by Dartmouth College scholar Brendan Nyhan, among others, has demonstrated.

"People get hung up on the true/false thing," said Nyhan, a former fact-checker himself. "It gets away from the core issue, which is whether something is a responsible claim to make in public life or not."

(Reporting by Jason Lange and Fred Barbash. Editing by Fred Barbash and Xavier Briand)

FILED UNDER:
We welcome comments that advance the story through relevant opinion, anecdotes, links and data. If you see a comment that you believe is irrelevant or inappropriate, you can flag it to our editors by using the report abuse links. Views expressed in the comments do not represent those of Reuters. For more information on our comment policy, see http://blogs.reuters.com/fulldisclosure/2010/09/27/toward-a-more-thoughtful-conversation-on-stories/
Comments (5)
Ralphooo wrote:
Rather than issuing a True/False verdict, publications could simply present the facts as clearly and objectively as they can manage.

Oct 16, 2012 2:32am EDT  --  Report as abuse
Geodude001 wrote:
“claims marked by ‘significant omissions and/or exaggerations’ are lies, and need to be reported as such. Only if the errors are insignificant and don’t substantially change the conclusion should the claim be considered true.

Oct 16, 2012 9:55am EDT  --  Report as abuse
AndreasJ wrote:
It is very hard to declare policy claims by politicians true or false.

However.

When a politician claims that six studies support his tax plan the curious journalist may shine. If four of the studies are not studies at all and one of the remaining studies actually contradics the claim, then there is a lie, plain as day.

Oct 16, 2012 7:31pm EDT  --  Report as abuse
This discussion is now closed. We welcome comments on our articles for a limited period after their publication.

A tourist takes a plunge as she swims at Ngapali Beach, a popular tourist site, in the Thandwe township of the Rakhine state, October 6, 2013. Picture taken October 6, 2013. REUTERS/Soe Zeya Tun (MYANMAR - Tags: SOCIETY) - RTR3FOI0

Where do you want to go?

We look at when to take trips, budget considerations and the popularity of multigenerational family travel.   Video