What is robots.txt?
Answers were Sorted based on User's Feedback
Answer / chaitanya
Robots.txt is a text file. It is through this file, it gives instruction to search engine crawlers about indexing and caching of a webpage, file of a website or directory, domain.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / nashiinformaticssolutions
It is a robots.txt text file. This file is used for everything. It tells search engine crawlers how to index and cache a domain, a webpage, or a file within a directory.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is keyword prominence in SEO?
What are robots.txt file?
How to change the crawler frequency for my website?
Tell me what are the seo tools do you use?
What makes a website search engine friendly?
Mention some of the reports in Google Analytics.
What is the difference between the singular and plural keyword phrases? What should we target in seo?
Tell me what will be your next steps if your seo methods or technique does not work?
What is Google Sandbox?
What are the character limitations of title and description tags?
Do search engines index alt text descriptions for jpeg and other image files?
What is google payday loan (spam) algorithms?