What is robots.txt?
Results 1 to 4 of 4

Thread: What is robots.txt?

  1. #1
    Join Date
    Dec 2015
    Location
    220 West Parkway, Unit 8A, Pompton Plains, New Jersey 07444
    Posts
    80

  2. #2
    Join Date
    Apr 2011
    Location
    Dallas, TX
    Posts
    261

  3. #3
    Join Date
    Jul 2017
    Location
    London
    Posts
    1
    Robots.txt file is used to scan different processes. This is a requirement if you want to improve your SEO scoring.

    Cannot explain how it works exactly however you can easily install robots.txt for your website if needed.

  4. #4
    Join Date
    Jan 2016
    Location
    New York
    Posts
    22
    Robots.txt is a text file placed in the server that can helps to command a bot ( eg. Googlebot) what are the pages, files, etc present in the website to be indexed or not. GoogleBot or other bot will first reads this text file while crawling a website. This concept comes under Search Engine Optimization techniques. If any help let me know, to help you on this.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •