How to manage robots txt file for a website please share your view ?
Printable View
How to manage robots txt file for a website please share your view ?
You have allow the website to index all pages & disallow which you want to block from search engines.
Ok, Thanks for reply, anything else about robots.
Also you can manage the hits from unwanted bots such as moz, other seo tools bots
good answer david
Evan Hel
You can create robot.txt with simple tools! Just google it and you will find so many.