How Google Uses Human Raters in Organic Search

how-does-google-use-human-raters-in-web-search

Insatiably curious blogger PotPieGirl stumbled upon an indexed copy of Google’s training manual for human URL quality raters in October. The 120+ page guide was more a reinforcement of search engine optimization (SEO) best practices than an earth shattering revelation of the inner workings of the organic algorithm.

The actual influence of these human raters is debatable; many believe they are used in troubleshooting and improving the algorithm, rather than having a direct impact on rankings.

Matt Cutts, Google Distinguished Engineer and head of the web spam team, tackled the subject in a Google Webmaster Help video blog yesterday, in response to a question submitted by SEO AJ Kohn. What did Cutts have to say?

“Raters Are Really Not Used to Influence Google’s Rankings Directly”

Human raters work under the Search Quality Evaluation Team and are used in the initial testing phases of proposed changes to the organic search algorithm.

“There are hundreds of raters who are paid to – given a URL – say, ‘Is this good stuff? Is this bad stuff? Is it spam? How useful is it?’” Cutts explained. Once those URL ratings are assigned, engineers can test proposed algorithmic changes within Google’s internal corporate network and have the new results evaluated.

That evaluation of new results should show whether the results tend to be better, according to Cutts.

“Raters Might Miss Some Spam or Might Not Notice Some Things…” and That’s OK

One of my previous posts discussed whether it was possible (and worth it) to try to optimize your site for Google’s human raters. At that time, a person claiming to be a Google rater had said in a forum that they processed between 30 to 60 of these evaluations an hour. They really weren’t going into any depth and were looking for more glaring issues.

As Cutts explains in his video post, this is just a part of the engineering testing process. Human raters don’t have to get it exactly right; there are hundreds of them working to evaluate URLs, giving Google insight into trends in proposed changes and the new results they produce.

If a proposed change makes it past these initial test phases, it is put to a side-by-side test, where two sets of results are pitted against one another and evaluated for relevance and improved user experience.

In side-by-side testing, human raters are assigned a query and two sets of search results in a sort of “blind taste test.” They simply indicate which set of results is better, in their opinion, and may leave comments for Google to consider.

You Just Might Be a Human Rater

After all of this internal testing, Google serves up the new results to a small percentage of users and use a variety of indicators to gauge user satisfaction. Human raters are “no substitute for the intuition and the experience search engine engineers have,” explained Cutts, pointing out that a change that rid results of spam may not resonate as the best set for the user.

“We do take the evaluation and the results of human raters, as well as the analysts who evaluate those results, very, very seriously,” he said. “We want to make sure that we’re launching a change that is, overall, a big improvement – ideally, at least an improvement – for users.”

“Those Ratings Don’t Directly Affect the Search Engine Results.”

Cutts tries to lay the rumor to rest that Google’s human quality raters have a direct influence on search engine rankings. Rather, they are a part of the massive testing process leading to some 500 or so tweaks to Google’s search algorithm annually.

If you can get your hands on a copy of the Google Human Search Quality Raters Guide, it’s still worth a read, if only to reinforce best practices in white hat SEO.

Source: http://searchenginewatch.com/article/2172154/How-Google-Uses-Human-Raters-in-Organic-Search

Advertisements

About SEO Updates
I'm an SEO :)

13 Responses to How Google Uses Human Raters in Organic Search

  1. Nice post at How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO Trends. I was checking continuously this blog and I’m impressed! Extremely useful info specifically the last part 🙂 I care for such information a lot. I was looking for this certain information for a very long time. Thank you and best of luck.

  2. wowoowowo says:

    How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO Trends Very nice post. I just stumbled upon your blog and wished to say that I’ve truly enjoyed browsing your blog posts. In any case I’ll be subscribing to your feed and I hope you write again very soon!

  3. gjkasuaw says:

    How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO Trends I was recommended this web site by my cousin. I am not sure whether this post is written by him as no one else know such detailed about my trouble. You’re amazing! Thanks! your article about How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO TrendsBest Regards SchaadAndy

  4. gjawua says:

    How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO Trends I was recommended this blog by my cousin. I am not sure whether this post is written by him as nobody else know such detailed about my trouble. You are amazing! Thanks! your article about How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO TrendsBest Regards Lawrence

  5. ee eee card consolidation credit credit card consolidation loan calculator e ee eee

  6. Rich says:

    Webmaster, I am the admin at SEOPlugins.org. We profile SEO Plugins for WordPress blogs for on-site and off-site SEO. I’d like to invite you to check out our recent profile for a pretty amazing plugin which can double or triple traffic for a Worpdress blog and we just posted a video showing the plugin in action. You can delete this comment, I didn’t want to comment on your blog, just wanted to drop you a personal message. Thanks, Rich

  7. TE says:

    I think How Google Uses Human Raters in Organic Search Latest SEO Updates | SEO News | SEO Trends is a informative post and you do a complete job of writing detailed information. TJ – http://www.ep2p4u.com

  8. I like this website so much, bookmarked. “To hold a pen is to be at war.” by Francois Marie Arouet Voltaire.

  9. I don’t even know the way I ended up here, however I assumed this put up was once great. I do not recognize who you’re however definitely you are going to a well-known blogger for those who aren’t already. Cheers!

  10. Wonderful, what a webpage it is! This website provides
    useful information to us, keep it up.

  11. I am extremely inspired with your writing skills
    and also with the layout for your blog. Is that this a paid subject or did you modify it yourself?
    Either way stay up the excellent quality writing, it’s rare to see a great blog like this one these days..

  12. Pingback: BlogFull.org

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: