GoogleBot, MSNBot, Yahoo!Slurp ... Everything about indexing Bots, ip lists, User Agents, Crawl and robots.txt.
Moderator: Moderators
by Peter77 » Sat Nov 24, 2007 5:03 am
This is especially helpful since many of us want to let MSN know about our sitemaps. At the moment, there is really no way to submit an sitemap to MSN search engine. But now that they are following sitemap standards, this may just do the trick.
Sitemaps.org wrote:You can specify the location of the Sitemap using a robots.txt file. To do this, simply add the following line:
Sitemap: <sitemap_location>The <sitemap_location> should be the complete URL to the Sitemap, such as:
http://www.example.com/sitemap.xmlThis directive is independent of the user-agent line, so it doesn't matter where you place it in your file. If you have a Sitemap index file, you can include the location of just that file. You don't need to list each individual Sitemap listed in the index file.
http://sitemaps.org/protocol.php#location
-
Peter77
- phpBB SEO Team

-
- Posts: 520
- Joined: Wed May 10, 2006 9:46 am
- Location: Michigan
by dcz » Sun Nov 25, 2007 2:09 pm
Thanks for sharing this useful information peter
++
-
dcz
- Admin

-
- Posts: 21219
- Joined: Fri Apr 28, 2006 9:03 pm
-
Return to roBots
-
- where i must put my robots.txt file
by AmirAbbas » Thu Jun 22, 2006 3:58 pm
- 7 Replies
- 2155 Views
- Last post by dcz

Sun Aug 20, 2006 12:15 am
-
- About robots.txt
by Peter77 » Tue Jun 06, 2006 5:15 pm
- 3 Replies
- 1439 Views
- Last post by dcz

Wed Jun 07, 2006 3:19 pm
-
- Hello, please help me with my robots.txt?
by tmaker » Tue Oct 17, 2006 4:10 am
- 4 Replies
- 1815 Views
- Last post by tmaker

Tue Oct 17, 2006 2:30 pm
-
- Help with robots.txt
by technofreaks » Tue Mar 27, 2007 7:19 am
- 8 Replies
- 1747 Views
- Last post by technofreaks

Tue Apr 03, 2007 7:09 am
-
- My robots
by fabiomaticus » Tue Jun 19, 2007 8:50 pm
- 9 Replies
- 1733 Views
- Last post by dcz

Wed Jul 11, 2007 7:26 pm
Users browsing this forum: No registered users and 3 guests