Hello I have a details page that takes the URL parameter Product-Code and
displays the details for that product. Now what happens when I remove a prduct
from the database and that URL still exists in the Search Engine indexes. I
noticed that even though the product code doesn;t exist anymore the page still
executes and shows all blank information. So basically I'm going to have all
those old product pages in search engines with no info and run teh risk of
duplicate content penalty. What shoudl I do. The site is programmed in CF. You
can see what I mean by visting the site www.juniorbaby.com and click on a
product and change the product code in the URL. The page will load with no
info. I feel my ranking has been dropping and this might be the problem. The
serach engine must think all those old pages are all the same. Any help would
be greatly appreciated.
Pete
Ian Skinner - 28 Nov 2007 17:49 GMT
Detect that the product code no longer exists and display a message
saying such to the user and the search engine. This would be much
friendlier then a blank page.
scuderia6 - 28 Nov 2007 18:11 GMT
Wouldn't this cause the search engine to believe that the product page still
exists. Inturn causing all my old product pages on the search engine to seem
identical? How could I let the SE know that this page no longer exists? I just
don't want the SE to have lots of pages indexed that no longer exist and have
the same title, desciption, etc...
SafariTECH - 28 Nov 2007 19:38 GMT
The SE will eventually update their content to the error message content.
What you may want to do is update your "robots" file so spiders will not index
that particular page at all. They will just get their links from the links in
the site then, and not actually spider that page any longer, error code or not
... eventually the page reference will disappear from the SE.
scuderia6 - 28 Nov 2007 20:22 GMT
Just a thought. What if I checked if the product existed and if it didn't I
would add a< robot noindex> tag in the header of the page. Would this cause all
my details pages not to get indexed. Meaning if details.cfm?PID=1234 doesn't
exist and I instruct the SE to not index the page would that cause the SE not
to index my other valid details.cfm?PID=validID pages. Any help would be
appreciated.
Azadi - 28 Nov 2007 20:37 GMT
1) SE != spider : some spiders follow rules you set in meat tags,
robots.txt, rel ttributes etc, others do not.
2) <cflocation> tag basically means http code 301 "temp moved" (or is it
302?): in cf8 you can set cflocation to return 301 or 302 code
(temp/permanently moved, whichever one is which).
3) use cflocation inside cftry/cfcatch (around retrieve product details
query) block to redirect your users to a full products listing page
4) google webmaster tools lets you request removal of a url from
google's search index - do that. if you are not using google webmaster
tools - shame on you!
---
Azadi Saryev
Sabai-dee.com
http://www.sabai-dee.com