Microsoft and Yale Get in Nerd Fight Over 'Bing It On' Challenge

rated by 0 users
This post has 3 Replies | 1 Follower

Top 10 Contributor
Posts 26,733
Points 1,209,520
Joined: Sep 2007
News Posted: Sat, Oct 5 2013 10:43 AM
The online search wars are serious business, so when Microsoft got called out by a Yale study suggesting the Redmond software giant's claims of users choosing Bing over Google at a nearly 2-to-1 clip in its "Bing It On" challenge are hogwash, Microsoft felt compelled to fire back and address each and every point of the study.

Let's back up a moment. Back in 2012, Microsoft conducted a blind comparison test of Bing versus Google via its Bing It On website, and during that test, almost twice as many people selected Bing's results. Then in 2013, Microsoft updated its claim from saying "People chose Bing web search results over Google nearly 2-to-1 in blind comparison tests" to "People prefer Bing over Google for the web's top searches."

Earlier this week, a Yale law professor published a study in which he and four Yale Law School students conducted their own blind tests on the Bing It On website. His results were far different from Microsoft's, with 53 percent of the participants choosing Google and 41 percent picking Bing; it was a tie among the remaining 6 percent.

Bing It On

"This is not even close to the advertised claim that people prefer Bing 'nearly 2-to-1," wrote Ian Ayres, the Yale law professor.

This prompted a lengthy retort from Matt Wallaert, a behavioral psychologist at Bing, who basically argues that there are several differences in the way Yale and Microsoft conducted their respective studies. One of the things he responded to is the fact that Microsoft doesn't release data from its Bing It On website, and the reason for that is because Microsoft doesn't track it.

"People who come to are not agreeing to participate in research; they're coming for a fun challenge. It isn't conducted in a controlled environment, people are free to try and game it one way or another, and it has Bing branding all over it," Wallaert explains. "So we simply don't track their results, because the tracking itself would be incredibly unethical. And we aren't basing the claim on the results of a wildly uncontrolled website, because that would also be incredibly unethical (and entirely unscientific)."

The Yale study also takes issue with Bing It On suggesting search queries, and Wallaert says those suggested searches are from a pool of 500 popular search terms in Google's 2012 Zeitgeist report.

"If Ayres is right and those topics are in fact biasing the results, it may be because we provide better results for current news topics than Google does," Wallaert argues.
  • | Post Points: 35
Top 10 Contributor
Posts 8,767
Points 105,080
Joined: Apr 2009
Location: Shenandoah Valley, Virginia

What's Bing?

Dogs are great judges of character, and if your dog doesn't like somebody being around, you shouldn't trust them.

  • | Post Points: 20
Top 150 Contributor
Posts 656
Points 5,955
Joined: May 2008
Location: Stockholm


What's Bing?

Got me !...


Not Ranked
Posts 2
Points 10
Joined: Jul 2013

Honestly, I prefer Bing. I used Google for years, but I just don't care for it anymore.

My top three reasons for moving over to Bing...

1) Bing Reward Points. I can get free Amazon gift cards, free Skype credits, etc.

2) I prefer the backgrounds. Every day the Bing background is different. I like the eye candy.

3) And the results of my searches are almost always perfectly identical anyway on both search engines. So might as well get the added benefit of reward points on Bing.

  • | Post Points: 5
Page 1 of 1 (4 items) | RSS