Results 1 to 6 of 6

Thread: Managing Robots.txt

  1. #1
    Join Date
    Sep 2017
    Location
    India
    Posts
    87

    Managing Robots.txt

    How to manage robots txt file for a website please share your view ?

  2. #2
    Join Date
    Feb 2016
    Posts
    55
    You have allow the website to index all pages & disallow which you want to block from search engines.

  3. #3
    Join Date
    Sep 2017
    Location
    India
    Posts
    87
    Ok, Thanks for reply, anything else about robots.

  4. #4
    Join Date
    Nov 2017
    Location
    New York
    Posts
    1
    Also you can manage the hits from unwanted bots such as moz, other seo tools bots

  5. #5
    Join Date
    Jan 2018
    Posts
    20
    good answer david

    Evan Hel

  6. #6
    You can create robot.txt with simple tools! Just google it and you will find so many.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •