Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


What is a robots.txt file?



What is a robots.txt file?..

Answer / nashiinformaticssolutions

Search engine bots can be instructed on how to crawl and index a website and its pages by using the Robots.txt file.

Because this file is in the.txt format, it contains simply text and no HTML code. Its function is to prevent search engine bots from visiting the website needlessly. This is typically the first file that crawlers see on the website.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Search Engine Optimization SEO Interview Questions

What do you think about the latest algorithm update from google?

0 Answers  


What does the 301-server response code signify? ► A. Not Modified ► B. Moved Permanently ► C. syntax error in the request ► D. Payment is required ► E. The request must be authorized before it can take place

1 Answers  


What types of links are no-follow?

0 Answers  


Explain cross-linking and its functions in seo?

0 Answers  


What will be your next steps if your SEO methods or technique does not work?

1 Answers  


Why is keyword research important in SEO?

3 Answers  


What will the following robots.txt file do? User-agent:Googlebot Disallow:/*? User-agent:Scooter Disallow: ► a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page ► b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page ► c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page ► d. None of the above

1 Answers  


How to change the crawler frequency for my website?

0 Answers  


Please explain what is xml sitemap?

0 Answers  


What are the basic actions that can be performed on search engines?

0 Answers  


How soon will some one see results?

0 Answers  


A Hallway Page is used to: ► A. Attract visitors from the search engines straight onto the Hallway Page ► B Organizes the Doorway Pages ► C Helps people navigate to different Doorway Pages ► D. Enables search engine bots to index the Doorway Pages

1 Answers  


Categories