Jump to:

Our volunteers haven't translated this article into ไทย yet. Join us and help get the job done!
You can also read the article in English (US).

Robots.txt is a file which is usually placed in the root of any website. It decides whether crawlers are permitted or forbidden access to the web site.

For example, the site admin can forbid crawlers to visit a certain folder (and all the files therein contained) or to crawl a specific file, usually to prevent those files being indexed by other search engines.

Learn more

General knowledge

Document Tags and Contributors

ป้ายกำกับ: 
ผู้มีส่วนร่วมกับหน้านี้: mdnwebdocs-bot, tedmcox, adithya_mani, klez
อัปเดตล่าสุดโดย: mdnwebdocs-bot,