What is robots.txt?
Answers were Sorted based on User's Feedback
Answer / chaitanya
Robots.txt is a text file. It is through this file, it gives instruction to search engine crawlers about indexing and caching of a webpage, file of a website or directory, domain.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / nashiinformaticssolutions
It is a robots.txt text file. This file is used for everything. It tells search engine crawlers how to index and cache a domain, a webpage, or a file within a directory.
| Is This Answer Correct ? | 0 Yes | 0 No |
Do you know what are paid results?
Tell me what is rss feed?
What are Webmaster tools?
What is the robots meta tag?
Tell me what is referral traffic?
How will you increase the pagerank of a page?
What are Spiders, Robots and Crawlers and what are their functions?
How do I get started with search engine marketing activities?
Does google use the keyword meta tags?
Is not seo just about meta-tags and submissions?
What is Keyword Density? ► a. The number of times the keyword is used / (DIVIDED BY) the total word count on page - (MINUS) the total words in HTML on the page ► b. Combination of the number of times a keyword or a keyword phrase, in proportion with other words, appears on a Web page ► c. The number of times the keyword is used in the page description ► d. The number of times the keyword is used in the page title ► e. The number of times the keyword is used / (DIVIDED BY) the total word count on the page
How does a search engine work?