Specifying the Sitemap location in your robots.txt file

GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.

Moderator: Moderators

Specifying the Sitemap location in your robots.txt file

Postby Peter77 » Sat Nov 24, 2007 5:03 am

This is especially helpful since many of us want to let MSN know about our sitemaps. At the moment, there is really no way to submit an sitemap to MSN search engine. But now that they are following sitemap standards, this may just do the trick.

Sitemaps.org wrote:You can specify the location of the Sitemap using a robots.txt file. To do this, simply add the following line:

Sitemap: <sitemap_location>The <sitemap_location> should be the complete URL to the Sitemap, such as: http://www.example.com/sitemap.xml

This directive is independent of the user-agent line, so it doesn't matter where you place it in your file. If you have a Sitemap index file, you can include the location of just that file. You don't need to list each individual Sitemap listed in the index file.


http://sitemaps.org/protocol.php#location
Peter77
phpBB SEO Team
phpBB SEO Team
 
Posts: 520
Joined: Wed May 10, 2006 9:46 am
Location: Michigan

Advertisement

Postby dcz » Sun Nov 25, 2007 2:09 pm

Thanks for sharing this useful information peter ;)

++
Useful links :
SEO Forum || SEO Directory || SEO phpBB || Search
____________________

Liens Utiles :
Forum référencement || Annuaire référencement || Référencement phpBB || Recherche
dcz
Admin
Admin
 
Posts: 21219
Joined: Fri Apr 28, 2006 9:03 pm


Return to roBots

 


  • Related topics
    Replies
    Views
    Last post

Who is online

Users browsing this forum: No registered users and 3 guests