I'm a novice @ website design as a post previously, but can anyone tell me where to put it in HTML code and what to put in it? (robot text)
thanks
joe w.
Printable View
I'm a novice @ website design as a post previously, but can anyone tell me where to put it in HTML code and what to put in it? (robot text)
thanks
joe w.
Actually you create a file - robots.txt and save it in the root web (usually where your index.html file (your home page) is).
I uploaded one example. When I created this a few years ago a lot of these that were listed were "bad bots". And it prevented my site from getting hit by spammers.
For more information check out the Web Robots Pages. Then their is this tool that will help you create your own robots.txt file. After you create it, check it with the Robots.txt Checker and that will help to explain it to you in layman's terms
awsome, this realy helped
thank you
joe w.
Glad to have helped - good luck with everything!
where am i supposed to put
User-agent: *
Disallow:
this is for all robots isn't it
what file do i put it in and is this all i need
i tried to put this in above my <head> in front of my tags
i didn't add a file into my public_html
thanks
joe w.
You create a txt file names robots.txt and upload it to the root (probably in the public_html folder. As long as it is visible when you go to www.example.com/robots.txt you have done it correctly.
got it and it is working
thanks
joe w.
Anytime - I am glad it is working - good luck with the site!
You can add code into the html of your Web site but not all bots are trained to recognize this additional code.
If you have set up a Google Sitemap you can use their tools to test your robots.txt file. They will also give you statistics of how many of your pages are open to Google's bot and how many you have restricted.
I will have to say that after a month of using robots text i'm on the first page on a google search of my ties "feather tie" and i now have images with google that i did not have at any time before
it is working for me
thanks again
joe w.
Very glad it is all working out :) It just takes patience
Robots text wont get you at the top of google.Quote:
Originally Posted by A. Joseph Wrigh
Have you been undertaking any linking strategies?
hi folks, i was doing a search on robot text and found this site. you have got some great help and information, so i decided to join!
i know that this was last years thread but
one quote in particular got my attention...i am a newbie and have a one page website that i am working on..
the statement by A. Joseph Wrigh really got me to thinking..how could i do that at a later time...
i don't know anything about it and need some help. could anyone get me started in the right direction to have this one webpage of mine to rank up on the first page searches?
thanks for the replies..
jon
Well of course 1st page position isn't that simple a thing to do, but in general when building your site, a few good places to start are,
Make sure your page title includes the name of the co. as well as some short blurb like -cosmetics or whatever your product or service is.
Don't use Flash for navigation or for text content
Don't use old style javascript menus, which write the menu on the fly. If you have flyout menus, be sure they're hard coded and just hidden/shown with javascript (but css is a better option)
Use text links where possible. If you have to use images for links, be sure the alt attribute is used and the title attribute.
A site map is a good idea too, for SEO purposes.
I'll leave the rest for roban, he's our resident SEO wiz.
If you have set up a Google Sitemap you can apply their tools to test your robots.txt file. They will also give you statistics of how many of your pages are open to Google's bot as well as how many you have restricted.
There is not need to write html in Robot text file, Some special codes are required to write there which you can find early in Google and this text file placed in Root folder of your project, Simple..........
They will also give you statistics of how many of your pages are open to Google's bot as well as how many you have limited. If you have set up a Google Sitemap you can enforce their tools to test your robots.txt file.
A robots.txt file is a short text file that is in your home directory. Before search engines spider your site, look at this file to see which files / file types and / or directories that are not authorized to see.
Thanks a lots to All of you for this information coz as it concern to search engine spider in matter to crawl so it very important to know and also how to implement in our site.
As I am newbie in this field so for me I have learn today something new and very much important.