How Does the Algorithm View Your Website?

Great article in the NYT over the weekend about an ad arbitrage directory named Sourcetool, which Google punted from the AdWords program. A couple quotes:

When I pressed Mr. Fox about Sourcetool, he refused to tell me why the algorithm had problems with the site. When I asked him why the business.com site was in the algorithm’s good graces but Sourcetool’s wasn’t, he wouldn’t tell me that, either. All I got were platitudes about the user experience. It wasn’t long before I was almost as exasperated as Mr. Savage. How can you adapt your business model to Google’s specs if Google won’t tell you what the specs are?

Business.com...

  • sells links (yes they have editors, but when they were interviewed about a year ago by Aviva Directory they only had 6 editors managing 65,000+ categories...many of the listings not only included aggressive anchor text, but also allowed the use of up to 5 spammy sub-links with each listing)
  • used nofollow on many of the free editorial links (while passing link juice out on the paid links)...this was corrected after we gave them a proper roasting on Threadwatch :)
  • uses a funky ajax set up to hide work.com content in a pop up (but makes it accessible to the Google crawler)
  • scrapes Google search results as "web listings" and in some cases Google ranks these pages! (Google is ranking a Google search result surrounded with Google AdSense ads, branded as Business.com)

Any one of those 4 would be enough to kill most websites, but because of Business.com's large scale, strong domain name, and brand they can do things that most webmasters can not. They are given the benefit of the doubt because Google can not clean up all arbitrage without hurting their own revenues - and Google's job it easier if they have to police a few thousand companies rather than millions of individuals.

Google also told me that it never made judgments of what was “good” and “bad” because it was all in the hands of the algorithm. But that turns out not to be completely true. Mr. Savage shared with me an e-mail message from a Google account executive to someone at another company who had run into the same kind of landing page problem as Sourcetool. The Google account executive wrote back to say that she had looked at the site and found that “there seems to be a wealth of valuable information on the site.” Consequently, her team overruled the algorithm.

Want to learn what the algorithm thinks? Read Google's remote quality rater documents. They tell you what Google wants and how the algorithm really works.

Algorithms (and under-waged third world employees labeled as the algorithm) often make mistakes. If a mistake is made when Google passes judgement against your site, is your site good enough to recover? If your site was deleted from the Google index would anyone other than you notice and care?

IE8 Beta Review: A Game Changer, Or More Of The Same?

I've been trying out Google's Chrome browser. I like it. I really do.

I like Chrome mainly because it is fast. Faster than Firefox, anyway. However, I'll be alternating between the two browsers, because Firefox has a plethora of useful plug-ins that Chrome lacks.

Like many Firefox converts, I haven't looked at Internet Explorer for some time now.

Microsoft have recently released IE8, so I thought I'd evaluate it in terms of search, and contrast it with the functionality and positioning of Chrome. Many in the internet community have speculated that Chrome is going to eat Microsoft's lunch, and not just in the browser space, but with the ushering in of cloud computing. Is this plausible?

Let's take a look.

Internet Explorer 8

You can download IE8 Beta from here. As usual, you'll have to sign your soul, and those of your yet unborn children, etc, etc over to Microsoft, and then reboot.

Goodbye Google Toolbar

You run through the inevitable setup screens. The first search-related issue I noticed was that Google's toolbar wasn't compatible with IE8 beta, and asks me if I want to disable it. Is a bug, feature, or a market position? ;)

Next up, IE8 asks you if you want to use "Express Settings", which means that the search provider will default to your existing default, and just about everything else defaults to Microsoft products or services. Internet Explorer also wants to become your default browser. At this point, you can opt for Custom Settings, and modify each setting individually.

Welcome To Internet Explorer 8

Pretty flexible, really. If you want to opt out of Microsoft services, you can do so easily.

The Search Wars

My main reason for looking at IE8 is in terms of search. What functionalities do you get, and how is this browser positioned against Google?

Search Suggestion

One feature, called Search Suggestions, offers, naturally enough, search suggestions. Like the equivalent Google feature, IE8 will try to guess what keyword you are search for a prompt you with suggestions as you type. This feature works with many different search providers (Google, Yahoo!, Live) and large ecommerce and content sites (Amazon.com, eBay, Wikipedia), which makes the search box a nice keyword research tool, but nothing new to most of us, I'm sure.

Note that this type-ahead feature, like on all browsers offering type-ahead suggestions, will send your search queries to your search provider, even if you don't hit send. Matt Cutts, perhaps sensitive to the privacy concerns aimed at Google, makes the point in this comment he posted on GoogleBlogoscoped that " if "Suggested Sites" is on, "your web browsing history is sent to Microsoft, .... the addresses of websites you visit are sent to Microsoft, together with some standard information from your computer such as IP address, browser type, regional and language settings.....".

Internet Explorer 8 Search Bar

How Will This Affect SEO?

An aspect SEOs need to consider is how the widespread implementation of search suggest is going to affect SEO. In this post, Aaron talks about how search suggest is likely to force a consolidation around the most popular terms. This has implications for those going after the long tail, but also provides new SEO opportunities, especially if you have a brand that incorporates popular search terms.

Explorer also allows search suggestion from any provider, which can be a useful SEO tool, in itself.

Visual Search

IE8 also offer Visual Search, which provides pictures to help you select a result. This didn't seem to work for me, but I did notice that a search on "Seattle Weather", the search term suggested by Microsoft, did bring up a page featuring advertisements for Australian outdoor sportswear suppliers. Reminds me how far other providers have to go in this text ad space in order to catch up with Google. It wasn't until I dug around a bit further that I discovered that you need to install search providers. Even then, it wasn't playing well, giving me a string of error messages.

Still, problems are to be expected in a beta release.

Other improvements include search history matching, a useful "Find On Page" button added to the instant search box, and the ability to drag the search box in order to change the width. A few nice touches.

Forced Search Provider?

On the Microsoft global-domination conspiracy front, far from locking you in, Microsoft have made it rather easy to configure IE8 to incorporate your choice of search provider. It wants to default to Live Search, but you can easily select Google, or other services. The pull-down search box provides options to add more. So, good marks in terms of flexibility.

There are various other features, including InPrivate browsing, which supposedly blocks ads and prevents people tracking you across the web. As it isn't search related, I won't review it, other than to say it is good that the user has to jump through a few hoops to enable it. Love 'em or hate 'em, web ads enable the production of a lot of "free" web content. If ads were turned off by default, many sites would simply cease to exist, or start charging for content. Full marks to Microsoft for leaving this option to the power users.

IE8 Vs Chrome

Now, contrast these features with Google's Chrome.

Did you find Chrome noticeably faster than your existing browser, be it Firefox or IE?

I did.

Speed was the deciding factor for me. On the internet, speed is (nearly) everything. IE8 didn't strike me as being any faster than Firefox, and certainly a lot slower than Chrome.

In this respect, IE8 feels like an update to an existing product, as opposed to a game changer. Chrome feels like a game-changer, even though, when pushed, I can't put my finger on exactly why this is. I think it may come down to the usability gains of extra speed, especially if your day to day use orients a search function. IE8 is adding functions, desktop application-stylee, while Google is busy taking features out in order to simplify and minimize.

If cloud computing is to take off, then the browser is going to need to need the speed of an application, and it is going to need to be simple and transparent in order for people to bother migrating.

Application-Centric Vs Web Centric

Chrome explains itself better. The Google information pages tell a cohesive story, whilst Microsoft's story appears scattered and a little confused. I'd liken Chrome to an Ipod. It lacks features some users might demand, but it works right out of the box for most people. Microsoft IE8 is, well....Microsoft. It feels more application centric.

Perhaps that says something about the web strategy of the respective companies. Google wants to pull users out of their existing habits, and into the Google web, whilst Microsoft needs to integrate existing application users with the web.

A subtle difference, but there nonetheless.

Have Your Say

What are your thoughts? Have you tried both new browsers?

Google Chrome: Germany Not Impressed?

Chrome, Google's new web browser, has made a huge splash everywhere this past week. User response has generally been favorable, however GoogleBlogoscoped is reporting that the German "Federal Office Of Information Security" may not be particularly happy with it:

"The Federal Office for Information Security warned internet users of the new browser Chrome. The application by the company Google should not be used for surfing the internet, as a spokesperson for the office told the Berliner Zeitung. It was said to be problematic that Chrome was distributed as an unfinished advance version. Furthermore it was said to be risky that user data is hoarded with a single vendor. With its search engine, email program and the new browser, Google now covers all important areas on the internet."

However, there appears to be no formal warning published on the Federal Office for Information Security's website. As various commentators point out, such an announcement would be odd, given that there has been no reported announcement about the IE8 Beta, which has also been released in a "unfinished advanced version".

Meanwhile, Matt Cutts is busy fighting "conspiracy theorists" regarding Google Chromes Terms Of Service. Some people were less than happy with the wording, which appeared to imply Google may assert rights to any content you submit, post or display on or through "the Services". Check out all the updates Matt makes as Google struggles to find the right words.

Google subsequently changed their Terms Of Service to read:

"11.1 You retain copyright and any other rights you already hold in Content which you submit, post or display on or through, the Services."

Could Google Chrome Change the SEO Field?

Search is the New Operating System

People far smarter than I have talked about the web becoming an operating system, and search being at the center of how we access the cloud. What better way for Google to position themselves as the C prompt than to turn the address bar into a search box?

I think operating systems are kind of an old way to think of the world. They have become kind of bulky, they have to do lots and lots of different (legacy) things. - Sergey Brin

Some have dismissed Google Chrome as being unoriginal, but it is "a step that needed to wait until the company had, essentially, come of age. It is an explicit attempt to accelerate the movement of computing off the desktop and into the cloud"

Google is Serious About Marketing Chrome

Sergey Brin stated that they did not intend to lower Firefox's marketshare, but a day after launch Google was already marketing Chrome on their homepage (internationally and abroad to users of Internet Explorer, Firefox, Opera, and Chrome!)

How the Omnibox Shapes SEO

Recently I mentioned how Google Suggest could change SEO, and the Omnibox drastically extends those effects. Google did not pull any dirty tricks to force their search service into being the browser default, but they did try to turn the address bar into a search box - which will increase how often we search. The Omnibox offers short cuts as you type:

The parts that are in black are related search queries and the parts that are in green are typically one or more of the following

  • the #1 ranking organic Google search result
  • pages you recently visited that are relevant to the search query

SEO Implications

The "search results before the search results" have major SEO implications:

  • Google is keeping some of the data entered before you hit the enter button. Getting people to search for your brand could be seen as another signal of quality.
  • Raising the awareness of your brand and getting many people to search for your brand will help your brand related queries show up when people search for broader related brands.
  • The value of a #1 Google ranking goes up, as the top ranked site has another opportunity to capture the searcher BEFORE they see the SERPs, and will be more likely to get clicked on when searchers see the search results (since they just saw the URL a second earlier).
  • The value of awareness advertising, website interactivity, and consumer generated content go up as they make you more likely to show up in the list of previously viewed pages.
  • For heavily advertised and/or frequently viewed pages I can see an advantage to adding a tomes of relevant text below the fold such that your site shows up for many related search queries. :)
  • Given Google's large ad network and their network advantages in search monetization, they will easily be able to buy marketshare through advertising on their own ad network and bundling this browser with hardware providers.
  • If the feature is widely adopted by other browsers it could lower the value of type in domain names (by making people more likely to search rather than type in a domain name). This could force some domainers to sell or develop, which could lower domain prices (and the .com premium)...this trend may already be underway given the pending Yahoo!/Google ad deal.

Your Thoughts?

How do you see Chrome changing SEO?

Domain Authority & Misplaced Trust

Sugarrae has a great post on how Google's policing of the web and pushing nofollow are undermining the social network and links that their relevancy algorithms are based upon. Worth reading from start to finish twice, then blogging about it. I would quote it, but a quote wouldn't do it justice.

The core issue is that Google places too much weight on domain authority and PageRank. Is The Wall Street Journal easy to trust? Sure...if they print garbage investors will stop buying their magazine. But even they publish garbage sometimes. Maybe Google could find a way to tune down domain trust and place more weight on other factors.

If Google decides that large networks should be trusted but that individuals should not be trusted much they are doing a bad job of encouraging web innovation. You only have to look at the entire history of mankind to realize that most innovation comes from individuals and small groups...not the large existing ones.

With as strong as Google is integrated into the web, if they are ever to fail their failure is more likely going to be due to an internal misperception than an external force. Great ideas are ignored, then shunned, then proven, then accepted. If Google doesn't make things accessible until step 3 or 4 they leave a big hole for competition in the search marketplace.

The path of least resistance and least trouble is a mental rut already made. It requires troublesome work to undertake the alternation of old beliefs. Self-conceit often regards it as a sign of weakness to admit that a belief to which we have once committed ourselves is wrong. We get so identified with an idea that it is literally a “pet” notion and we rise to its defense and stop our eyes and ears to anything different. — John Dewey

Free SEO Tips for Google Search Suggest

Google announced that over the next week they are going to implement their Google Suggest search suggestion feature on Google.com. This change will help searchers find popular keywords that other searchers recently searched for.

Short Term Influence on Search

When this search suggest change is coupled with the recent launch of automatic matching and the new quality score update it may consolidate PPC competition against a smaller set of core industry keywords. Some outlier keywords, like misspelled terms, are going to be much harder to build a traffic stream from.

This will also likely have the effect of focusing organic search attention on a smaller set of well defined queries. And the extra competition in the PPC space will drive yet more competitors to adopt SEO practices. But as an SEO smarter than 99.9% of other web publishers, you have some profitable drafting opportunities you can use to build a profitable search traffic stream. :)

SEO Drafting Tips

  1. Search Query Drafting: If you can create a brand that starts with and industry keyword and drive search volume on it then your brand can show up for some people looking for the broader topic. For example, a webmaster may not have enough PageRank/link authority to rank for seo, but if they can create enough hype around their brand then maybe people search for it and their brand related search query shows up as a suggestion around the broader search queries. This is something that should also be taken into consideration when coming up with official names and page titles for leading resource oriented linkbaits.
  2. Brand Drafting: If SEO Book is a decently strong brand and a fairly generic keyword, and SEO Books is the second most popular term suggested right below it then you might be able to pick up some of that search volume by ranking at or near the top for that alternate version. An April Hitwise blog post showed that in the US nearly 15% of brand related queries were intercepted by third part websites, and that was *before* Google launched search suggest directly on Google.com.
  3. Brand Coupon/Discount Drafting: This is an extension of the above type of drafting, but rather than creating a compilation of sorts you focus on getting an affiliate commission for offering consumers a discount on the core brand. Many consumers will be reminded that there are coupons, discounts, promo codes, and reviews to find and read through when reviewing popular brands.
  4. Media Drafting: This technology is already live on Youtube, so Youtube presents 4 ways to draft popular media.
  • create a video optimized for a phrase that is already popular on YouTube
  • create a video optimized for a phrase where you think the video has a good chance of ranking high in Google results
  • create a video that has a title similar to other popular YouTube content that is watched by hundreds of thousands or millions of people
  • create a relevant video that is a video reply to a video that is already well received

Long Term Influence on Search

  • For websites and businesses that have no intent of building a real brand and intend to run primarily as an organic search arbitrage player the significance of domain name may be lowered significantly.
  • As people get more acclimated with using search to navigate the web (as many people already do) then some brands and domain names that seemed too long and not viable may become viable marketing platforms.
  • Conversely, short acronyms may lose some of their value as people become acclimated to having the search engine help complete their search queries.

Your Turn

How do you see search suggestion influencing how we search and how we write?

Google Insights for Search

Google recently added search volume estimates to their keyword tool. They also recently launched Google Trends, Google Hot Trends, Google Trends for Websites, and the Google Ad Planner. And now Google hits the competitive research market with yet another product - Google Insights for Search

Insights for Search shows the following search data

  • relative keyword search trends for keywords (and A/B comparisons between keywords)
  • top related keywords and hottest rising related keywords
  • category based top keywords and category based hottest rising searches (and overall top 10 rising searches)
  • category based keyword search volume trends, and the relative growth of a keyword compared to its category
  • countries, states, and cities where a keyword query is popular
  • you can also mash up many data points, like celebrity searches in New York in the last 30 days

Keywords are weighted such that their top volume day is anchored at 100, and other days are represented as a relative percentage of that search volume.

Just like their Google Trends tool, by default Google Insights for Search defaults to the broad matched version of a keyword, so a word like credit will show more volume than credit cards, even though credit cards gets more search volume (because terms like credit cards and credit reports count as search volume for the word credit). Credit vs credit cards pictured below:

This type of tool can also be used to see how related some generic concepts are to more specific related concepts, and how much news coverage and marketplace changes move the relative importance of different keywords in a marketplace. Public relations experts will be able to use graphs like the following to say "hey our brand is catching up with the market leader."

Rather than brand lift and PR lift being an abstract concept, we can compare brands in real time and see which markets resonate with our brands and marketing. When marketing is working *really* well you can consider boosting early success in the most receptive markets via offline advertising, social interaction, and live events. If I wanted to hold an offline seminar guess what state is most receptive to my brand? The one I live in. That's pretty cool. :)

And the problem with such tools? It is easy for me to lose days or weeks playing with them. What are your favorite search data tools? What creative ways do you use them?

Google Beta Testing Showing Related Phrases Near Documents in Search Results

While using Opera I noticed the following Google test which places related phrases near some documents in the search results

When I entered our above link building page into the Google AdWords Keyword Tool they showed mostly phrases related to the broader category of SEO and did not list the niche link related phrases, which indicates Google is still holding back quite a bit of data from advertisers that they are willing to share with searchers for free.

Google Knol - Google's Latest Attack on Copyright

Knol Off to a Quick Start

One day after Knol publicly launched Wil Reynolds noticed that a Knol page was already ranking. Danny Sullivan did a further test showing that 33% of his test set of Knol pages were ranking in the first page of search results. Danny was also surprised that his Knol was ranking #28 after 1 day. After citing it on his blog now that Knol page ranks #1 in Google!

Google's House Advantage

From the above data (and the aggressive promotion of YouTube content after the roll out of universal search) it is fair to state that house content is favored by the Google algorithm.

Another Knol Test

Maybe we are being a bit biased and/or are rushing to judgement? Maybe a more scientific effort would compare how Knol content ranks to other content when it is essentially duplicate content? I did not want to mention that I was testing that when I created my SEO Basics Knol, but the content was essentially a duplicate of my Work.com Guide to Learning SEO (that was also syndicated to Business.com). Even Google shows this directly on the Knol page

Google Knows its Duplicate Content

Is Google the Most Authoritative Publisher?

Given that Google knows that Business.com is a many year old high authority directory and that the Business.com page with my content on it is a PageRank 5, which does Google prefer to rank? Searching for a string of text on the page I found that the Knol page ranks in the search results.

If I override some of Google's duplicate content filters (by adding &filter=0 to the search string) then I see that 2 copies of the Knol page outrank the Business.com page that was filtered out earlier.

Some may call this the Query Deserves Freshness algorithm, but one might equally decide to call it the copyright work deserves to be stolen algorithm. Google knows the content is duplicate (as proven by the notification they put on their page), and yet they prefer to rank their own house content over the originally published source.

Hijacking Your Rankings via Knol - Google Knoljacking

Where this becomes a big issue is if a person...

  • posts your content to Knol
  • and buys/rents/begs/steals/spams/borrows a couple decent inbound links

they can get you filtered out of the search results - even if your site is an authority site. Bad news for anyone publishing copyright work online.

Google Knol Undermines the Creative Commons Spirit

Some new publishers decide to license their work via Creative Commons (hoping to be paid back based on the links economy), but Google wants no part in that! All outbound links on Knol are nofollow, so even if a person wants to give you credit for your work Google makes it impossible to do so.

Google Voids YOUR Copyright

Why do I get enraged by this sort of activity? I remember when one of my sites was voted against, and Google paid someone to steal it and wrap it in AdSense. The person who stole my content outranked me for my own content because a Google engineer thought that was reasonable and fair.

To this day someone publishes seobookopen.blogspot.com, a site dedicated to stealing and sharing an old version of my ebook. As the opening post on that blog explains

www.seobook.com very famous book from Aaron Wall its really good but paying $79 its really sucks so yesterday, I think why not to share this book to my friends etc openly in text by decompling Acrobat files

Can a casual mention get it removed? Nope. Can flagging it as spam and highlighting that it is stolen copyright content get it removed? Nope. I need to file a DMCA request to get it removed. (Or maybe they will remove it out of embarrassment after I hit publish on this post...we shall see!)

Google Pays Thieves

Google doesn't like lonely cheating housewives, unless it favors their business objectives.

Help Improve My Google SEO Knol & Win a Free 3 Month SEO Training Trial

Squidoo, Mahalo, eHow, EzineArticles, etc etc etc just got validation for their business models and competition for the ad network that helps them monetize their sites. Google today launched their Knol project:

The key principle behind Knol is authorship. Every knol will have an author (or group of authors) who put their name behind their content. It's their knol, their voice, their opinion. We expect that there will be multiple knols on the same subject, and we think that is good.

With Knol, we are introducing a new method for authors to work together that we call "moderated collaboration." With this feature, any reader can make suggested edits to a knol which the author may then choose to accept, reject, or modify before these contributions become visible to the public. This allows authors to accept suggestions from everyone in the world while remaining in control of their content. After all, their name is associated with it!

Wired has an article about the designing of Knol, and Danny Sullivan offers more Knol background, including that it is a product from the search team (which could greatly hint at future search integration plans).

Want a free 3 month trial of our SEO training program and community?

Comment on my SEO Knol leaving tips on how I could improve it and a way to contact you, and I will pick a winner next Wednesday.

Pages