Page 1 of 2 12 Last>>
Results 1 to 15 of 19

Thread: robot text

  1. #1
    Join Date
    Mar 2006
    Location
    usa
    Posts
    35

    robot text

    I'm a novice @ website design as a post previously, but can anyone tell me where to put it in HTML code and what to put in it? (robot text)
    thanks
    joe w.

  2. #2
    Join Date
    May 2004
    Location
    Castle Rock, CO
    Posts
    355
    Actually you create a file - robots.txt and save it in the root web (usually where your index.html file (your home page) is).

    I uploaded one example. When I created this a few years ago a lot of these that were listed were "bad bots". And it prevented my site from getting hit by spammers.

    For more information check out the Web Robots Pages. Then their is this tool that will help you create your own robots.txt file. After you create it, check it with the Robots.txt Checker and that will help to explain it to you in layman's terms

  3. #3
    Join Date
    Mar 2006
    Location
    usa
    Posts
    35
    awsome, this realy helped
    thank you
    joe w.

  4. #4
    Join Date
    May 2004
    Location
    Castle Rock, CO
    Posts
    355

  5. #5
    Join Date
    Mar 2006
    Location
    usa
    Posts
    35

    Angry didn't work

    where am i supposed to put
    User-agent: *
    Disallow:
    this is for all robots isn't it
    what file do i put it in and is this all i need
    i tried to put this in above my <head> in front of my tags
    i didn't add a file into my public_html
    thanks
    joe w.

  6. #6
    Join Date
    May 2004
    Location
    Castle Rock, CO
    Posts
    355
    You create a txt file names robots.txt and upload it to the root (probably in the public_html folder. As long as it is visible when you go to www.example.com/robots.txt you have done it correctly.

  7. #7
    Join Date
    Mar 2006
    Location
    usa
    Posts
    35
    got it and it is working
    thanks
    joe w.

  8. #8
    Join Date
    May 2004
    Location
    Castle Rock, CO
    Posts
    355
    Anytime - I am glad it is working - good luck with the site!

  9. #9
    Join Date
    Jun 2005
    Location
    Philadelphia, USA
    Posts
    321
    You can add code into the html of your Web site but not all bots are trained to recognize this additional code.

    If you have set up a Google Sitemap you can use their tools to test your robots.txt file. They will also give you statistics of how many of your pages are open to Google's bot and how many you have restricted.

  10. #10
    Join Date
    Mar 2006
    Location
    usa
    Posts
    35
    I will have to say that after a month of using robots text i'm on the first page on a google search of my ties "feather tie" and i now have images with google that i did not have at any time before
    it is working for me
    thanks again
    joe w.

  11. #11
    Join Date
    May 2004
    Location
    Castle Rock, CO
    Posts
    355

  12. #12
    Join Date
    May 2006
    Posts
    10
    Quote Originally Posted by A. Joseph Wrigh
    I will have to say that after a month of using robots text i'm on the first page on a google search of my ties "feather tie" and i now have images with google that i did not have at any time before
    it is working for me
    thanks again
    joe w.
    Robots text wont get you at the top of google.
    Have you been undertaking any linking strategies?

  13. #13
    Join Date
    Mar 2007
    Posts
    1

    Question about search page ranking?

    hi folks, i was doing a search on robot text and found this site. you have got some great help and information, so i decided to join!

    i know that this was last years thread but

    one quote in particular got my attention...i am a newbie and have a one page website that i am working on..

    the statement by A. Joseph Wrigh really got me to thinking..how could i do that at a later time...

    i don't know anything about it and need some help. could anyone get me started in the right direction to have this one webpage of mine to rank up on the first page searches?


    thanks for the replies..

    jon

  14. #14
    Join Date
    Jan 2005
    Posts
    2,087
    Well of course 1st page position isn't that simple a thing to do, but in general when building your site, a few good places to start are,

    Make sure your page title includes the name of the co. as well as some short blurb like -cosmetics or whatever your product or service is.

    Don't use Flash for navigation or for text content

    Don't use old style javascript menus, which write the menu on the fly. If you have flyout menus, be sure they're hard coded and just hidden/shown with javascript (but css is a better option)

    Use text links where possible. If you have to use images for links, be sure the alt attribute is used and the title attribute.

    A site map is a good idea too, for SEO purposes.

    I'll leave the rest for roban, he's our resident SEO wiz.

  15. #15
    Join Date
    Apr 2011
    Posts
    15
    If you have set up a Google Sitemap you can apply their tools to test your robots.txt file. They will also give you statistics of how many of your pages are open to Google's bot as well as how many you have restricted.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •