Google Ranking #6 Penalty / Filter

A New Google Filter is Born

In early December some astute webmasters noticed that some of their longterm (in some cases many years) #1 or #2 ranking pages in Google now rank at #6. Just like with the Google -30 and the Google -950 penalties, some people will maintain this is fiction, but too many smart people experienced the same thing at the same time for it to be such.

Background Information

Tedster started a WMW thread on the topic on December 26th. From Tedster's post, some of the sites that were hit:

  1. Well established site with a long history.
  2. Long time good rankings for a big search term - usually #1
  3. Other searches that returned the same url at #1 may also be sent to #6, but not all of them
  4. Some reports of a #2 result going to #6.

My Site That Got Hit

My site which saw a ranking dive on December 18th had the homepage hit, and interior pages hit for some (but not all) related phrases. Here are some noteworthy conditions with my site that was hit:

  • The site was entirely ranked on SEO. There is no ad budget outside of PPC ads or link buying, and no brand recognition outside of the search results. Outside of one linkbait there is nothing remarkable about the site.
  • The homepage did not get any new quality links in over a year.
  • Much of the link building was done years ago when I was far spammier and far more aggressive with anchor text than I would be today, though I did use some semantic variation to pick up rankings for many different keyword permutations.
  • The internal pages still rank #1 for some semi-related longer queries, while they are also filtered and ranking #6 for some more obviously connected shorter search queries.
  • The site continues to buy PPC ads and gets decent conversion rates for the keywords that were hit, and gets great conversion rates for more focused related terms, some of which the site was hit for and some of which the site still ranks great for. This conversion data is being sent to Google via the AdWords conversion tracker.
  • This affected alternate permutations of acronyms (letters strung together or pulled apart).
  • For my site this affects rankings on alternate versions of words (ie: single vs plural). For at least one person on WMW they did not see it affect both single and plural versions of their keywords.
  • This affects words if mixed into a different order.
  • This affects many longer search query containing the core words or closely related words.
  • This did not affect obvious domain name or brand related queries, even if the brand contained one of the words overlapping with the penalized set. If a filtered word outside of the domain name / brand name is appended to the query then the rankings are killed, and the site is stuck at #6.

Usage Data or Improved Phrase Relationship Detection of Anchor Text?

Why I do Not Think it is Usage Data

Based on feedback in the WMW thread it is hard to isolate this to any one variable with certainty. Two possibilities that have been thrown out are rolling more usage data into the search results or a better understanding of word and phrase relationships. It is easy to think of usage data as a possibility given my site's lack of marketing and lack of integration into the organic web, but that would not explain why some pages and queries were hit while some similar pages and queries still rank, with Google getting strong conversion data via AdWords on some of these pages. Also, for that homepage I wrote an aggressive page title and meta description that draws in many clicks, and the landing page is exceptionally relevant for the query.

Why I Think it is Phrase Relationships

I think this issue is likely tied to a stagnant link profile with a too tightly aligned anchor text profile, with the anchor text being overly-optimized when compared against competing sites.

The fact that some related queries were hit, but not all, makes me think that rather than being about usage data this is about word and phrase relationship improvements. I think if Google got better at understanding word relationships, many of the pages that once fit the criteria to rank may now have anchor text that is too focused and too well aligned with the target keywords, especially if they compare your anchor text to the anchor text of other sites competing for the same phrases. Once possible manipulation is identified via artificial anchor text your rankings across the site can be suppressed for a basket of semantically related terms, as noted in some of Google's phrase based indexing patents.

Matt Cutts Does Not Know What Happened

This filter was also called the minus 5 penalty, but many of the sites that were hit still rank at #6 even if they were ranking #2 or #3 before they were hit. When Barry posted about this Matt Cutts said "Hmm. I'm not aware of anything that would exhibit that sort of behavior," but some past SEO issues, like the famed Google sandbox have been accidentally introduced as a side effect of Google upgrades:

What's a sandbox, Matt?

"Some people have asked, "does this apply to newer sites?" Essentially, the way to think about it is, around 2003 Google switched to a new method of updating its index. Before that we had monthly Google dances. So as a result, new data is always being folded into the index. It's not like there was one pivotal moment when anyone can say, "Hah! This is the change!" In fact, even at different data centers we have different binaries, different algorithms, different types of data always being tested.

"I think a lot of what's perceived as the sandbox is artifacts where, in our indexing, some data may take longer to be computed than other data."

Great Comments About the Filter

3 great posts from the WMW thread:

Your Feedback Needed

With my sample set of one site my current hypothesis might be out to lunch. If you have any sites that you feel were hit and want to share them for helping everyone figure out what is going on please do so in the comments below. If you have any ideas or feedback on what happened please leave a comment with that too.

Many Big SEO Firms Make Chicken Scratch

I recently got a copy of AdAge's year in review. Since the 2001 web bust almost every job field in advertising is flat or down, with the exception of a sharp growth in the number of people working as marketing consultants. AdAge also listed the top 20 search marketing firms. I think the 2006 numbers for the 20th firm had like 5 million in revenues with something like 260 employees. Some companies may not want to be on such a list for competitive reasons, but the companies on the list are likely rounding up on the numbers and counting whatever they can as revenue. That comes out to revenues of less than $20,000 per employee, which stinks when you consider that if you deliver any real value to the clients and are growing your business some of that spend needs to go into

  • doing market research
  • buying PPC ads
  • marketing your own consulting business
  • office related overhead
  • employee benefits
  • travel
  • taxes
  • creating custom software
  • buying links
  • etc.

Some of these companies have been around for 10 years and have CEOs who go to 20 or 30 conferences a year. I have been on the web less than 5 years and am already getting burned out on conferences. I could not imagine going to that many conferences when we have kids. And none of these companies made as much per employee as I do. Even my wife, who is still quite new to the web, is doing far better than these firms are at producing return. I am afraid that she might be beating me come this time next year. Gulp :)

The same day I read AdAge, another magazine about SEO came in that I do not remember subscribing to. Out of the whole magazine, I only saw 2 names I even recognized. I think many of the people who wrote articles also bought ads from the same site. Along with the magazine was an offer for an SEO contest where you pay a $5,000 entry fee, with the promise that the winner will be shopped to CIOs of fortune 500 companies.

  • First off, what firm is going to pay $5,000 to enter a contest?
  • Second, what client worth having is going to want to pay consultant rates only to have have third parties looking over their marketing? I have consulted some fortune 500s, and I can tell you that some of the ideas proposed by them and some of the ideas I proposed might not look pretty to third parties. If something works only because it is exclusive then where is the value in sharing it?
  • Third, what fortune 500 company that has not got into search yet is going to be impressed by some arbitrary paid award? And which of them got to the size of a fortune 500 company while moving that slowly on a large market (like search) without being the type of company that would research the background of such an award?

My partners and I are quite selective with what clients we are willing to take on, and we price toward the high end based on our brand strength and experience, but in most cases we only get a fraction of a fraction of the value created. I do not think that the SEO market is bleak though, I just think that companies who believe in it ultimately bring it in house, and after they have an in house team there is only so much they can pay external consultants before the competency of the in house team is questioned.

To appreciate how many people have an in house SEO team, even a search engine tried hiring me a while back, but that would have been a big pay cut. And I can not tell you how many times I have seen a mainstream media company write an article trashing SEO only to have someone from their in house SEO team send me an SEO question via email a week later.

As marketers we have to keep moving ourselves up the value chain. There is only so much value you can provide as a third party consultant. Adding 100 extra employees means that you are adding bulk workers for automation, but the best marketing can not be automated. And if you want scale it pays much better just to own your own site and network. Give me 200 SEOs (or maybe just 5 of them), a designer, a programmer, a few writers, and 5 years, and I should be able to create a BankRate, Monster.com, or a WebMD in whatever markets I aggressively pursue. And, according to the market, that pays much better than consulting work does.

New Year's Resolutions for 2008

Improve SEO Book - the ebook format and sending updates via email have a lot of friction associated with them. Perhaps so much so that I should have realized it and changed my business model years ago. A partial list of that friction includes

  • shipping questions (for an ebook)
  • a text that takes a while to read
  • a format that presumes you want to read the whole thing
  • a text too large for most people to want to re-read the whole thing when it is updated
  • requests for special addendums when updates are done, which would make the whole book structure quite pointless
  • a text so large that it is hard to update
  • refund requests within 3 minutes of purchases by people who bought it with intent to steal it
  • people trying to sell it on eBay or on their websites
  • a lowered perception of value due to using a format that is often associated with scams

There are many ways I can add value to SEO Book and enhance value transfer to customers if I turn the purchase process into establishing a relationship. There needs to be more backend support for learning. With internet marketing getting more complex I need to make learning easier, more granular, and more interactive.

Treat SEO Book more like a business - I sorta stumbled into SEO, and honestly have not treated this site like a business like I should have. Over the years some of my mentors have given me many great tips that I was too lazy or scared to listen to at the time. After seeing one of my favorite SEO sites go offline it makes me want to treat this site more like a business so I can still focus attention on it for years to come, even while some of my other projects have grown to be more profitable.

Make my other sites more like SEO Book - I have some other sites that do pretty well without adding much value to the web. At some level I feel there is a moral obligation to start adding value to markets as you extract profits. Plus, if relevancy algorithms moved away from links and domain trust many of those domains (as they sit today) would be screwed. I want to create more product and service oriented websites and be less reliant on advertising and affiliate based income streams.

Try to get at least 2 weeks away from the web - this will be mid year sometime with my wife, in a one month European honeymoon.

Read more away from the web - I always learn a lot from reading books, and I doubt I would miss much if I cut how much time I spent reading recycled online content.

Start working out more again - after losing a bunch of weight I gained it back due to stress from doing way too much stuff. I have eased up my work load and am chipping away at it.

Spend more time with my wife - given that we both work on the web we spend lots of time near each other, but far too much time working and not enough time playing.

Set a better examplewhat competitors do I want to put a lot more effort into creating things worth copying.

DietsInReview.com Reviewed (or, Why Email Spam Whois Data of Bloggers With High Touch Marketing Ideas?)

Some marketers aggressively email spam people to promote their best ideas, thinking no harm could come from it. If you do not take the time to personalize emails and actually visit the sites you are emailing then you probably going to send someone like me an email, and there is a 5% chance I will blog about it. If I blog about it, I am probably not going to be talking up the product. ;)

DietsInReview.com recently launched their celebrity weight loss calculator. I was sent a bulk unpersonalized email containing the following tip

The tool is specifically un-branded so it can blend with your experience. All we ask is that you post the entire code which contains a link back to our site.

Their site has a great growth chart. They come up with great marketing ideas. They are clever with SEO. And they are too lazy to connect the pieces without untargeted email spamming. Silly. Spend $10 an hour hiring someone to send out the emails if you are too lazy to do it yourself.

If you are reactive to blog feedback (like they were here kimkinscontroversy.com/2007/09/25/kimkins-affiliate-spotlight-dietsinreviewcom/) then why not be proactive in creating meaningful relationships in the community? No point putting great ideas on churn and burn sites, and no point burning relationships with leading editorial voices in your market if you are creating a longterm site.

My Powerpoint Presentations from Pubcon

A number of readers emailed me asking to send them my WebmasterWorld Pubcon Powerpoint slides. Downloads:

Here they are online as well:

I am a big fan of the low fi powerpoint look. :)

The Next US President is a Bad Marketer

As Frank Luntz says "it's not what you say, it's what people hear." Politics is a game of marketing. Raise money, invest in messaging, and spread the message.

Most of the leading presidential candidates are not running AdWords ads to place a donation message on search result. Given Howard Dean's experience in raising money online, where they tested and changed page layouts based on donation data, the Democrats ought to know better.

Few candidates are buying display ads. Given this data, I am buying more display ads for SEO Book than any of the presidential candidates are.

You do not need to be a conversational marketing guru to advertise. In a couple hours I could create a campaign for any of the candidates that gets in excess of 100,000,000 monthly impressions and brings in far more than it costs. They are doing interviews on TechCrunch about technology and the web. Why don't they put their money where their mouth is?

Wal Mart SEO Services

Anyone surprised that Sam's Club offers SEO services?

I think I am going to fight back by selling Chinese made US flags for 3 cents each. :)

How to Save Over $1,000 on Next April's Tax Bill

The year is almost out, and tax time is just around the corner. Here are some tips for SEOs and web marketers on how to lower your income by increasing your expenses.

  • Donate to Charity - want to do some good? Why not donate some cash to a good charity?
  • Domain registration - make sure your domains are registered for at least 5 years.
  • Buy a better name - does your domain name suck? Now is the perfect time to buy a better one.
  • Hosting - have hosting bills coming up soon? Pay them early.
  • Directory registration - if any of your good sites are not yet listed in BOTW, Business.com, JoeAnt, or the Yahoo! Directory then submit before the year is out
  • Yahoo! Search Marketing - if you are a big user of Yahoo Search Marketing you can pay a few thousand extra in advance
  • Affiliates (& other Marketing Costs) - do you have payments that are typically done on the first of the month? Consider paying them early.
  • Website design & custom programming - need new features or a fresh look to take your website to the next level? Make that down payment made in the next couple days.
  • Software & tools - thinking about trying out a piece of software? Now is a great time to buy.
  • Sell loser stocks - did you buy CountryWide at $45 earlier this year? Get the writedown you deserve.

What are your best tax tips?

Why Did the Search Marketing Associations Fail?

One of the big differences between things that are successful and things that fail is simply staying around and staying active in the community. By those measurements, the regional Search Marketing Associations were all failures.

  • SMA-UK.org - blog last updated a little over 2 years ago
  • SMA-NA.org - dissolved in September of this year
  • SMA-EU.org - now a PPC lander page

Cooperatives are exceptionally hard to run because you have to balance business interests, egos, recruiting new members, creating member benefits, and pull time out of your schedule for the organization. And if you don't see what the other members are doing, it seems unbalanced, so you go back to working on your own projects. Even a partnership with only a couple people can be a bit of work to balance when you add in individual business interests outside the partnership and balancing work with family life.

It is exceptionally hard to create organizations that are for everyone. Many of the top marketers in the SEO space get paid more precisely because the field has a dirty reputation. I put that theory to test a few years back when I created a non-self-promotional guide to buying SEO services, registered the domain via proxy, and, in spite of having core community members mention it, watched it fall flat on its face. It seems virtually everyone who wanted to make the industry better only wanted to see improvement if their name was attached to the improvements.

In most cases if you want to create a successful trade organization or group exclusivity is much more effective strategy than appealing to everyone.

Wikia Search Alpha Launch

Search is so consolidated that it is uncomfortable being an SEO. If Google decides to profile you or kill your sites there is not much you can do, especially because Yahoo! and Microsoft are losing marketshare month after month. Why are Yahoo! and Microsoft losing marketshare? Their bad marketing coupled with Google's good marketing:

The toolbar has NEVER given anyone any real information. BUT, it has given the world a perception that whatever Google ranks that must be right. It has also helped to give Google millions of devout followers and millions more who are willing to give access to a lot of private data just to see a little green go a little farther to the right. BRILLIANT. So brilliant in fact I have never understood why MSN and Yahoo haven’t done their own white paper and give away a little blue bar to "prove" it works. BUT, that is why Yahoo and MSN seem to be losing market share. Not because their results aren’t as good. It is because they aren’t as good at marketing. I don’t begrudge Google for that. I admire them.

To appreciate how bad Yahoo's marketing is, consider the following:

  • Overture Keyword Selector - their public facing keyword tool is unreliable and does not even promote their own brand or their own network on it.
  • Want to sign in to Yahoo search marketing? Go to sem.smallbusiness.yahoo.com. Yup...2/3 of the companies revenues come through a subdomain of a subdomain.
  • Yahoo powers millions of domain landing pageviews every day, and are afraid to put their brand on it, all while Google puts their brand (and typically search box) on everything they touch.

Anyhow, this is Christmas and this is supposed to be a happy post. And I am happy, because Wikia Search just launched in Alpha, and plans to publicly launch on January 7th.

Given that the difference between Google and Yahoo is largely one of marketing, and given that Google has been doing more manual editing of the search results, that lends credibility to Wikia's human search model.

What happens when Wikipedia has a "search powered by you" box promoting an engine other than Google on every page of Wikipedia? Does Wikipedia keep ranking #1 for everything? Does this create another viable search channel for marketers? Does this competition make Google less arrogent and harsh in their webmaster relations department?

Here is Wikias' whitelist, and here is a blog tracking Wikia's progress. And here are some of Google's human review documents that were leaked a couple years ago.

Pages