Answer Posted / Barun Choudhary
Robots.txt is a text file that webmasters create to instruct robots (search engine crawlers) on how to crawl and index their website. It can specify which pages or sections of the site should be accessible, blocked, or crawled with specific rules.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
