Forum Moderators: Robert Charlton & goodroi
What do we really know about this penalty, what causes it, and most important of all, how do we fix our sites to restore normal rankings?
I used one of the keyword density tools available through a search at our friend Google, and verified those same keywords/keyphrases. I then reduced keyword density by 20 to 30% for those search terms, and voila - back to normal ranking in SERP across all data centers. Took a little over 24 hours.
Thats not a very controlled experiment, was the cache date on the page with reduced keywords new in Google? If not, then Google was most likely using your older page anyway. It is doubtful that that effect could be fixed in 24 hours by reducing on page text and seo. Any one else?
The same page which has not had any noticable recent links with the other keyword still rank high for the other keyword. Note that the links for this particular site are all one way, and the links that came to us were given to us without our knowledge. I now see this for more than one website.
Randle, did you experience this? Anyone else see a trend?
I also removed 301 redirects of defunct pages that were now pointing to home page.
Anyone else see a trend?
We have not been able to identify any definite trends, on page or off. Our sites that got hit range quite a bit in terms of how much optimization they have. In addition, we have sites very similar to these that did not get affected.
But, the first thing that really weighs on your mind in times like these is an OOP, and that’s what were thinking about now.
On the day that we dropped 950 spots, all of a sudden webmaster tools is telling us that the Google robot could not find certain weird pages on our server(that frankly we never in any capacity claimed existed).
SEOJoe, when did you get penalty, and how long did it take to recover? My penalty seems to have kicked in starting Sunday the 15th.
[edited by: PhattusCattus at 12:20 am (utc) on Jan. 17, 2007]
And we really don't do any intentional SEO. But several friends added links to us recently.
Now can't even find any of the tons of news articles about us in news archive unless we specifically do NOT use our domain name in the query.
Seems like this was some sort of blocking action.
Did you look at all these:
and this post from Matt
[mattcutts.com...]
Things are not looking that straight, complex structure try to fool a search engine and you will go straight to h?.
As these are automated stuff and I guess once we remove those unwanted stuff we may go back to where we were. Till then we got cooked.
Regards
"Call a SEO or do SEO to get out of business or at least from Big G"
Now there is nothing white hat or black hat except for subject centric title and rest all H1, alt tag are junk or of no use at all. If you do something interesting then big g will show a deeper interest in you and he will put you in a deeper position where he can see you but not everybody else.
Enjoy our good karma
Perhaps being an SEO (as was) is now the kiss of death :-)
Our series of sites is also suffering from this problem. I have to put in a vote of agreement for the fact that Google seem to be targeting this at very retail heavy areas.
This is absolutely not what I'm seeing. I have pages with NO ads, NO retail, NO ADSENSE, absolutely NOTHING except unique, original content, and they are at the bottom of the results. Many don't even have H1 tags, and have a very low percentage of keyword duplication (- 2%), so no overoptimization on them, either.
There's more to it than just heavy retail, although that could be a factor for some sites, I suppose, because this does not apply to my site at all.
* Removed templating where possible, at least the boiler plate stuff Adam Lasnik referred to a recent posting on dup content
* Removed mecahnisms that automate or generate category specific pages, including paging (page1=, page2=) and temporarily reverted back to a static html site to test the theory.
* Ensured there was not "over categorization", but just a collection of top categories. Esnured that each category page had unique content, unique meta descriptors and unique titles.
* Ensured keyword density for anchor text was moderate and not over optimized there either
* Gave more prevelance via interlinking to content rich, unique articles within our site.
* Cleaned up htaccess and 301 redirected old pages to new pages, removed all unecessary category pages from the server that were likely uneeded but still showing up in the main index. Ensured a 404 status served for all the removed pages, blocked these pages using robots.txt
While we had some hesitation about making drastic changes to soon, we are starting to see positive results already and rankings are starting to return to normal. Perhaps our site had more issues than other sites, and our combination of issues is different than another site's combination of issues, but perhaps there is something in our list of things done that other can take away for their own site.
Mine was about 80% of my keywords, i was worried that it was from over aggressive link building.
My website is a new website 4 months on an old domain - 5.5 years
Only external links are to the web guy, and one of my sites (related).
I have a commercial site with no ads and a separate page for every state, and then to the counties.
100% original content
duplicate content on the county pages
Anyway i did not touch the site and it is back today, so it was only for a brief period.
But i did pray to the google gods.
All my new pages since August 2006 appear to have been hit. When each page is first included in the serps I receive what I would consider to be a normal ranking. Then after a period of days or slightly longer the page will bomb. For example from page 2 to page 24. Sometimes I have two pages on a similar subject. This could be a review and a video guide. Both pages will bomb but one page could end up in say position 70 and the other in position 240.
Pages before August 2006 appear to be unaffected. I haven't checked them all as there are too many. There is nothing really different about the pages I have written before or after August 2006.
Before Christmas I requested reinclusion. This appeared to have been granted as all my rankings returned. A week later they all bombed again.
I consider the site to be white hat. I pay no real attention to keyword density, but don’t think it is an issue. I just write the pages and do nothing special in terms of optimisation.
I have read various guidelines and cleaned up a few minor points, but to be honest I cannot find much to clean up.
My latest page to bomb was cached by Google on 6th January, but didn't bomb for another 9 days. Not sure what this means.
The site has been online since 1999. It has thousands of pages - all original content. It has price comparisons on product pages but little else in the way of banners or other advertising. I run an RSS feed, but other than that do nothing in terms of linking.
Absolutely no idea what is causing the problem. Didn't even notice until late November as I never paid much attention to rankings before now!
"Call a SEO or do SEO to get out of business or at least from Big G"
I don't think it means this. In fact, it means that SEO's who spend even more time researching, being careful, finding more natural linking, and are willing to go that last mile will get more work. This is of course only true if this paper and it's suggestions are applied correctly in google, something that has not been the case in the last series of updates I can remember.
The face of SEO is changing, and what we do changes daily. Those that keep on top of information like this and wisely mull it over / consult it's usefulness and message will no doubt be here tomorrow...
Are you saying that after fixing all those stuff your ranking come back to original. I don't expect that ranking for all KW will return back to normal, it will take time till googlebot will confirm that things got fixed on your web pages.
One thing I am not very much sure because if bot is finding a single page which has some kind of problem or a kind of optimization like over KW density, focus on lot of stuff, packed with kw and some unknown problem it will trigger this action and penalty will be domain wide means.
Regards
I guess the days of just building nice looking sites for your visitors, with interesting pages, adequate navigation, descriptive links, and original content are gone. Because the average webmaster is going to make some mistakes, and Google is going to slam them for those mistakes.
I've spent months going back looking at everything that's happened since my site was first impacted in November 2004. And it has never fully recovered from whatever hit it at that time. Yet I see lots of other pages that provide less information than mine rank far above mine.
And during this time, new content is close to non-existent on my site, because I'm spending all my available time trying to figure out what's wrong, and trying to implement a fix. I don't want to be a SEOer. I want to build pages that people can find that will be helpful to them. Yet I cannot do that because I must learn SEO, whether I want to or not, or accept the fact that my site will always be buried in Google.
I do have a following that is devoted to my site, and that makes it somewhat worthwhile, but they have also expressed frustration that they can't find my site in Google. One guy told a friend to Google for a search term on my site. The guy did so, used the exact phrase in the title of the page, the only page on the Internet with that title, and couldn't find it. Out of frustration, he called his friend, who had to go find the URL and give it to him. Both of them were amazed that it wasn't listed in Google. Well, it is: it's at #755 out of 813 results, and I must say that the neighboring URLs that low in the results are definitely "BAD NEIGHBORHOOD". In fact, it's downright embarrassing to be listed among them!
Google is not winning any brownie points with people when things like this happen. I think in some of the niche areas, Google's lack of understanding of the various related search terms, how things meld together, and how seemingly similar things may not be similar at all in the real world, is beginning to show Google's shortcomings.
For instance if you have a site about widgets, with sections for widgets made in 1903, and there are pages for each year, make, model, size, etc., while in an algorhythmic way on the surface 1902, 1904, 1913, even 2003, etc., might seem similar, they are in the real world very, very different. Just the fact that one number changes in a model number can make all the difference in the world. And when you aren't actually SELLING widgets on this particular site, one has to wonder how such a site could be filtered so drastically. Yes, an affiliate link or two is on the site for people to buy widget-related stuff, but most of the content pages have no ads whatsoever on them. 90%+ of the pages on the site have nothing on them that provide income. What the heck is Google filtering?
Google needs to face the fact that not everyone is out to beat them: some of us just want others to be able to find our site when they search for terms our site deals with. I don't have to be #1, but I sure as heck don't feel like I should have to accept being at #755, or #813, or whatever all the time, especially when an eBay auction selling something that ended a week ago is listed above my pages, or when an ad on a national for sale site ranks above mine, and the item has already sold. That isn't relevancy.
So, instead of adding new, original content to my site, here I am futzing with the HTML, afraid to do too much, afraid to do too little, and not at all sure that what I'm doing is fixing the problem in the first place.
I don't think it should be all that hard for Google to determine whether a site is spam or not: if there aren't any ads on 90% of the pages, if there's only one site owned by that person or company, and if the domain is old and paid for years in advance, chances are pretty good that site isn't spamming anyone, including Google. And chances are also quite good that the person who owns that penalized site has no idea they've even done anything wrong. Yet with so little traffic, they don't continue developing the site because they feel no one else is interested in it. So, a site that could have been great stagnates and dies a slow death.
Meanwhile, people are searching Google for terms that that site can address, and they aren't finding it listed. If they go to Yahoo, MSN, Ask Jeeves, Dogpile, etc., they will find it. But only if they look for it there. And with almost half of the search traffic, Google could very well be disappointing a huge percentage of their customers.
In an attempt to deal with spammers, Google has forgotten why people are using Google in the first place: to find relevant sites. Having relevant sites listed at #755 in the SERPs isn't going to help anyone.
(End of rant - sorry, but I'm very frustrated. I just saw a thread on a subscription only online mailing list about how there isn't any information out there about so and so, the person spent 2 hours looking for it on Google over the weekend, and couldn't find anything. Well, it's on my site, the page it's been on has been online since 2001, and for 4 years it was #1. Now it's buried. And I don't know why. That page could have saved the guy a couple of hours, because the info he needed was readily available, and answered his question and solved his problem in under 5 minutes. But that isn't relevancy in Google's world...they'd rather show a bunch of junk to the guy instead, none of it answering his question, none of it solving his problem. Repeat several million times a day, and you get an idea of the user experience for many people.)
I'm not too concerned as I think google will realize in the long or short term that what they've done with this apparent tinkering is not going to lead to a better user experience, and is not going to sell more Adwords.
For one, many of our Adwords are only borderline profitable on their own. But for others that have the reenforcement effect of us appearing in the natural SERPs, our conversion ratio is good. Apparently people click on your ad, and then quickly scan and look for you in the natural results to see if you only bought your way in or if you are really an authororitive site for their search query.
Thank G-d we have lots of news articles and posts about us listed in the natual results, which dampens the effect of this. But honestly, we now probably going to invest more in advertising at Y & MSN, and since we're listed in the SERPs there, we should see good results.