HustleBlog

This is key, you are dumb not to do it. When a spider finally hits your site, it asks for the robots.txt file as we all know. This is where we can tell it to not look at certain pages, etc. Well we can also tell it the location of our sitemap file. Include a line like:

Sitemap: http://www.example.com/sitemap.xml

This will help engines find more of your pages.