

News Archive
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
Eye-tracking Proves Real-Time Search Not Useful
March 10, 2010, 2:19 pmOneUpWeb recently released the results of an eye-tracking study on Google’s new real-time results integrated into SERPs—and it looks like the search giant might have just wasted $15M (the estimated cost of Google’s deal with Twitter).

The study segmented web users into two groups: consumers and information foragers. It took consumers 7.09 seconds to look at the real-time results, even though they’re listed just below the news results and before the organic results. In fact, they scrolled below the fold to view the image results before they fixated on the real-time area, the eleventh area they focused on.
Information foragers took slightly longer to turn to the real-time results: 7.39 seconds. It was the thirteen area their eyes focused on—but the first 12 areas were all just above the real-time results in the news results. (The search task here was to research a selected current news item using the search engine of choice—for 89% of all participants, that was Google.) (Side note: I’m not sure why the times in the above graph are so much higher than the numbers OneUpWeb also provided that I used in these paragraphs.)
The second search task was segmented by group—the consumers were to look for a product they were considering to buy for themselves or for someone else as a gift. Information foragers were to again look for information on a current news topic. Interestingly, in this second set, consumers were five seconds faster than information foragers to focus on real-time results.
Meanwhile, 20% of consumers and 30% of information foragers actually clicked on real-time results, as opposed to 69% of consumers and 60% of information foragers that clicked on the top 5 results excluding real-time.
I’ve long argued that real-time results will only be helpful for a very small, select set of data—and for that set, most people would know to go to Twitter or Facebook in the first place anyway. I’m not the only one. The Guardian’s Charles Arthur points to several others who feel the same way, most notably Nick Carr, who sardonically chronicles the efforts to organize the web’s information around 140-character ephemera.
And yet Google insists that this information is useful and must be foisted upon the user. Aruther quotes Marissa Mayer last summer:
We think the real-time search is incredibly important, and the real-time data that’s coming online can be super-useful in terms of finding out whether – something like, is this conference today any good? Is it warmer in San Francisco than it is in Silicon Valley? You can actually look at tweets and see those types of patterns emerge, so there’s a lot of useful information about real-time interactions that we think ultimately will really affect search.
Apparently users don’t quite agree yet.
What do you think? Are real-time results useful?





