The Twitter Political Index could be one of the most powerful social media tools of the election.
Right now, if you want to know how the country feels about Barack Obama or Mitt Romney, you have to rely on pundits' intuitions or traditional opinion polls, conducted as they always have been — by phone, over the course of hours or days. There's no direct way to check the pulse of millions of actual people, simultaneously and directly, second by second.
Twitter is launching a tool today that it says will fill that gap, and sort through the 400 million tweets a day from 140 million active users. Twitter and real-time search engine Topsy are launching the "Twitter Political Index," a daily assessment of how Twitter feels about Obama and Romney, in an election cycle that's being played out moment-to-moment on the social service.
The index, which Twitter has retained Democratic and Republican polling firms (the Mellman Group and North Star Opinion Research) to help perfect, appears to be the most serious and large-scale effort yet at a metric that has so far produced a lot of flops.
The rough version of how it works: Topsy pores through every single tweet in real time, determines which ones are about Obama or Romney, and then assigns a sentiment score to each tweet based on its content. That is, whether it's positive or negative toward Obama or Romney, and just how positive or negative it is. Add all the data up together and you have something like a real-time approval score for Obama and Romney, determined by what tens of millions of people are saying, which Twitter is going to release daily at election.twitter.com.
Again, it's scale of the data that makes this project so powerful. With Topsy's access to the full Twitter firehose, it's processing 400 million tweets a day in real-time. To compare, on Election Day 2008, there were 1.8 million tweets. There are that many tweets every six minutes today.
The Twitter Political Index leverages the growing science of sentiment analysis, in which computers — machines! — try to assess what the meaning or feeling of a piece of writing really is. Which isn't easy — particularly for "short form content like tweets, which often lack context," Topsy's chief scientist Rishab Ghosh tells me. But Topsy's algorithms agree with a randomly selected human 90 percent of the time on what a tweet means, validated over 30,000 tests. (It's hard to get to 100 percent because humans often disagree on what a tweet means. Also, machines are still terrible at picking out or assessing sarcasm or irony. So, "Good job, Obama!" with a link to an article about crappy job numbers might fly past the algorithm as a positive tweet. )
The index's scale runs from zero to a hundred — higher is better — and Obama and Romney are measured individually, not against each other. So both could be over 50, or both could go up simultaneously. Or down simultaneously. It's not a head-to-head poll. "We are not actually are measuring whether people prefer Romney to Obama or not," says Ghosh. It's just "a broad sentiment measure of what's going on."
