Wrox Programmer Forums
Go Back   Wrox Programmer Forums > Web Programming > HTML > HTML Code Clinic
|
HTML Code Clinic Do you have some HTML code you'd like to share and get suggestions from others for tweaking or improving it? This discussion is the place.
Welcome to the p2p.wrox.com Forums.

You are currently viewing the HTML Code Clinic section of the Wrox Programmer to Programmer discussions. This is a community of software programmers and website developers including Wrox book authors and readers. New member registration was closed in 2019. New posts were shut off and the site was archived into this static format as of October 1, 2020. If you require technical support for a Wrox book please contact http://hub.wiley.com
 
Old August 30th, 2004, 02:04 AM
Authorized User
 
Join Date: Nov 2003
Posts: 44
Thanks: 0
Thanked 0 Times in 0 Posts
Send a message via Yahoo to eapsokha
Default Importance of Robot file

Does anybody know about robots.txt located in the root directory of website and its importance and use?

Many thanks:)
__________________
Mr. Sokha Eap
Webmaster
UNDP Cambodia
 
Old August 30th, 2004, 05:14 AM
Friend of Wrox
 
Join Date: Jun 2003
Posts: 425
Thanks: 0
Thanked 3 Times in 3 Posts
Default

Here goes.
http://www.robotstxt.org/wc/exclusion.html

(o<
//\ =^..^=





Similar Threads
Thread Thread Starter Forum Replies Last Post
Multiple Robot Support for SLAM kurmob BOOK: Professional Microsoft Robotics Studio ISBN: 978-0-470-14107-6 2 February 24th, 2010 11:43 AM
Importance of SSL Certificates trents4life ASP.NET 2.0 Basics 0 November 24th, 2006 09:17 AM
Importance in CDO patwadd Classic ASP Databases 2 August 15th, 2004 05:54 PM





Powered by vBulletin®
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright (c) 2020 John Wiley & Sons, Inc.