« Review : Wipeout 3 for PS | Main | Review : Tenchu Stealth Assassins for PSOne »
Breaking the Mobius Loop of Search Strings
In an effort to stop the site searched from being indexed and linked by Google and related search engines I have added a meta tag with to the Search page.
‹ meta name="ROBOTS" content="NO INDEX, NO FOLLOW" ›
and a robots.txt file with the settings
User-agent: *
Disallow: /cgi-bin/
Disallow: /Searches.php
Hopefully this will in time stop the loop of people looking for key words that are not here and Google thinks that the search word results are content.
This hopefully will stop people looking for
hot dookie sex
ugky jews
Free Blonde Icons
spiderman parody
download Metroid Fusion
and doll icons
Jake at March 11, 2003 
WebDev
Trackback Pings
TrackBack URL for this entry:
http://www.8bitjoystick.com/cgi-bin/mtype/mt-tb.cgi/80
Comments
do you think you don't get any regular readers off of google searches?
give us an updated in a few months if you see any changes after doing this.
Posted by: Anita Rowland at March 11, 2003 2:15 PM
I put this tag only on my Searches page. It is a listing of search strings that people have been searching on my site using the MT-Search.cgi not Google. I am asking Google to ignore my search page but the rest of my site should not be affected. I get an average of 20% of all my traffic from search engine referrals. I don't think that asking Google to ignore one page will affect the rest of my site.
Posted by: Jake at March 11, 2003 2:22 PM
Yeah Jake is right. Really all he is trying to do is make it more efficient so as not to clutter up the place....and stuff.
Posted by: pete at March 11, 2003 8:36 PM
Yah, it is a great idea Jake. I am planning on doing this myself, but my site needs some heavy redesigns before it is google friendly.
Just out of curiousity, where you experiencing problems with search engines going into a loop?
This comes to mind: http://stopdesign.com/log/default.asp?date=20030218
Posted by: Stephen at March 11, 2003 11:25 PM
The loop is that I had a script that created a list of what people were searching for in my internal search engine. Some racist and perverted stuff came up. Google thought the list was actual content and entered it in it's snapshot of my site. These are some techniques so next month when Google and other search engines update their mental images of my site the racist and perverted search strings will be ignored. It is not a bit deal but I have learned a hell of a lot about the web and media my running this site.
Posted by: Jake at March 12, 2003 12:03 AM
how do you think i found your site in the first place? by searching for "hot dookie blond icon spiderman sex" of course.
Posted by: tj at March 12, 2003 4:48 AM
