Let’s take on the Googlebot Spider together. Put your armor on, grab your swords and let’s get fighting!
I did this test on SEOWebHelp and a friend’s site. For the test below I used search engine spider simulator from our friends over at WebConfs.
Test 1 Spidered SEO Web Help:
SEO Web Help SEO Web Help Search Engine Optimization Help – The First Ever Web 3.0 SEO Blog! HomeContact SEO Advertise Search Featured Search Engine Optimization Post Welcome to SEOWebHelp
Yes, it works! Test 1 was a success.
Test 2 Spidered my friend’s site:
Affiliate Program Resellers Program Shopping Mall Normal0falsefalsefalseMicrosoftInternetExplorer4 Normal0falsefalsefalseEN-MicrosoftInternetExplorer4 Normal0falsefalsefalseEN
Hmmm. Test 2 seems to get lost in the code somewhere. Prehaps his code is causing an error or blocking the spider from digging deeper.
Ok. Ready your swords soldiers!
meta name=”googlebot” content=”nofollow”
Tells Google spider not to follow any links on your page. This will not offer the link any link juice.
meta name=”googlebot” content=”noarchive”
If your server’s down, Google will show the last crawled page as a cached page.
meta name=”googlebot” content=”noindex”
Google grabs your page for display to the visitor, but doesn’t index it.
meta name=”googlebot” content=”noindex, nofollow”
This is how you can show 2 commands on one line.
Google spider has been slayed. You are a hero!
Note: My code tag didn’t work, so add a opening “greater than” symbol on the front and “less than” symbol at the end of each meta tag line. Thanks to dotSpiral.com for making the image for us.



[...] Meta tags [...]
Hello,
and the link to google
Sound tips! Thanks for sharing them.
RT @kathrinkawaters: Social Media : Taking on Google meta tags http://snipr.com/cxve9
Thanks for the tips! Love the blog.