Google Ranking Drop Because Of Duplicate Content

Sunday, October 12th, 2008

This is a follow up post to my previous posts about my friend’s Google ranking drop. As you may remember, his Google ranking was restored a few weeks after he blocked the proxy from copying his entire and submitted a Google reinclusion request. As you may have guessed, he was quite thrilled to see his SERP ranking shoot up again.

Well, as luck would have it, I received a phone call last night from my friend telling me that his was bombing again. I Googled his favorite keywords and they seemed to rank fine over at my end, but he explained that he traffic stats from Google was flat. They nosedived a day or two ago. I chalked up the results I was getting to Google adjusting the results.

This new twist got me thinking. What in the world could be making this ’s ranking bounce around like this? Looking back, the proxy may not have been 100% at fault. There has to be something else.

I began doing a little research and learned about few things about . The reason I looked at that particular area is because there is absolutely nothing else I can find wrong with this . seems to be a rather popular culprit.

I came across a pretty well laid out called “Google Rankings Diagnostics” that describes a whole heck of a lot of issues you might be having with your . This validated what I pretty much already knew…that if you have multiple URLs (on a domain) with the same exact content, Google has trouble figuring out which page is the original and may throw all of them out.

I took a very close look at my friend’s . Again, I took a unique line of text from his homepage and searched for it in Google (inside quotes). A funny thing happened. I saw the homepage result, but there were a few extra results as well, all on his domain. There were about 5 extra pages in total.

Now, some of these extra results have been there for years, so I don’t attribute the issue to those pages being . What struck me was one of the extra pages.

A few months ago, my friend moved one of his pages. He put a 301 redirect in his .htaccess , which was the correct thing to do. So now, the old directory where the page was held forwarded to a new page. It looked something like this:

Redirect 301 /olddirectory/ http://www.hiswebsite.com/newpage.

The redirect worked fine, but here is what that extra page in the looked like:

http://www.hiswebsite.com/newpage.phpoldpage.

Guess what page was showing at that URL…yup, the homepage. The dynamic nature of his sends unknown page results like this to the homepage. This was a fluke. My friend forgot that there were pages inside the old directory he redirected to the new page. Every old page in that old directory was tacked on to the new page, like you see above. To make matters worse, there were a bunch of links from other websites pointing to the old pages in the old directory.

I am not sure if this would cause the ranking drops that he is experiencing, but the timing certainly lines up with when the issue began. It is also certainly considered .

So, here is what I did to deal with the issue this time. I deleted the redirects in the .htaccess and blocked the URLs of all those extra results in the robots.txt . Hopefully, this will tell Google to not spider or index those pages and it will also tell Google that those links into the site are dead.

Now, we have to wait. I am not going to submit another reinclusion request to Google because I want to see if the ranking returns naturally. If it does, this was the problem for sure.

Related posts

Tags: , , , , , , , , , , , , , , , , , , , , ,

How to Set Up a Custom 404 File Not Found Page

Wednesday, September 17th, 2008

Ok, this is a pretty simple thing to do and it has some important benefits.

Have you ever visited a or a web page only to find that annoying “Not Found” message? If so, what did you do? You probably got ticked off, hit the back button and visited another . Can you imagine someone coming across a “Not Found” page on your ? Well, if you don’t have a “File Not Found” page set up on your , that might just be happening.

Here is what you need to do to fix this problem and keep your visitors on your .

The first thing is to create a web page with some sort of message on it. Something like, “Whoops, looks like the page you are looking for isn’t here. Please click this link to visit our home page or our …” You get the idea. You can save the page as “404.” or something similar and upload it to the root of your web server.

Oh, I forgot to mention this. In order to do what I am suggesting here, you need to be running an web server and your web host has to allow changes to your .htaccess file. I am sure there are other ways to create a File Not Found page and get it up and running, but I am only talking about one way here.

Now, open up your .htaccess file and place this code into it somewhere. I like to place it right on top:

404 /404.

I am using . extensions for this stuff just because of habit and preference. You can use .html or whatever you wish.

Well, that’s basically it. You can now save your .htaccess file and upload it to the server and go see if it worked. Try typing in some page that you know isn’t there. If it works, please read my previous post about “How To Check Your Web Page HTTP Headers & Response Codes” for some important information.

Good luck.

Related posts

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

How To Check Your Web Page HTTP Headers & Response Codes

Tuesday, September 16th, 2008

There may be cases when you would like to see what your webpage HTTP headers look like. Why? Well, because they are kind of important. As Wikipedia states, the headers define what the returned looks like.

Still you ask, “Why in the world do I care about that?” Ok, I’ll keep going. The main reason I look at the headers is to find out what the HTTP status code is. The reason the status is important to me is because this is the the search engines use for a multitude of things.

Let me give you a little example, and this related to my previous post regarding the sudden drop in Google rankings. As I was doing research into what the problem may be for this particular website, I came across an issue where someone had recently put “404 Not Found” error pages up on some of their . Everyone knows that “404 Not Found” error pages are cool, but what some people don’t know is that if those pages show a “200 OK” (successful requests) , the site may be in big trouble, SEO-wise. The reason for this is because there are going to be many “404 Not Found” error pages on a dynamic website. If you have your “404 Not Found” error page showing a “200 OK” , the search engines will think that all the instances of this page are . You know as well as I do, that spells trouble.

What’s worse is if you set your as your “404 Not Found” page. Your is going to return a of “200 OK.” That’s not good, because now you have multiple instances of your …all content.

It’s my opinion that the search engines are smart enough to figure this out. The page (such as your ) with the highest Pagerank will prevail. Still, I have some that I am working on that have multiple instances of the and they all have Pagerank, which isn’t good, because the duplicates are taking the Pagerank from the real page. Now, again, that’s my opinion.

Here are two tips:

- How to check your headers - visit this website or just Google “Website header check”

- How to set a particular page as your “404 Not Found” error page in your . - Just place this in the file: “ 404 /404.php” without the quotes. The 404.php file is the actual error page in this case.

Related posts

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , ,