What is robot.txt?
- 1 Answers
- 828 Views
- I also Faced
- E-Mail Answers
Answer / Barun Choudhary
Robots.txt is a text file that webmasters create to instruct robots (search engine crawlers) on how to crawl and index their website. It can specify which pages or sections of the site should be accessible, blocked, or crawled with specific rules.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is SEO? What are the important types of SEO methods?
What is the name of the search engine technology due to which a query for the word ‘actor’ will also show search results for related words such as actress, acting or act?
What is press release submission?
What is the difference between 'organic seo' and 'natural seo'?
Why is Dwell Time important for SEO?
Have you ever dealt with link penalties? How?
Which of the following search engines offers a popular list of the top 50 most searched keywords? ► a. Google ► b. Yahoo ► c. AOL ► d. Lycos
. What is a PBN?
What is cloaking in seo?
The following robots Meta tag directs the search engine bots: <META NAME="robots" CONTENT="noindex,nofollow"> ► a. Not to index the homepage and not to follow the links in the page ► b. Not to index the page and not to follow the links in the page ► c. To index the page and not to follow the links in the page ► d. Not to index the page but to follow the links in the page
What is the difference between on page seo and off page seo?
Where do you put your robots.txt?
HTML DHTML 
