Seocheckout

Clear
Sign In Join

Is it true Robot.txt are no longer used with google

  • seohelper2012 Level 1
    • 5

    Write the reason you're deleting this FAQ

    Is it true Robot.txt are no longer used with google

    I wanted to know if its true robot.txt are no longer needed for google seo purposes

    #google #seo #sitemap #analytics Google
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    Bert

    Bert

    They are still valid if you don't want the search spiders to crawl certain pages. This is what the robot.txt file is for. They didn't really have any seo purpose anyway and most people don't bother with them.
    13 years ago
    1970-01-01T00:00:00+0000

    Are you sure you want to delete this post?

    riacom

    riacom

    me same used it to block certain pages
    12 years ago
    1970-01-01T00:00:00+0000

    Are you sure you want to delete this post?

    Corzhens

    Corzhens

    To be honest I do not know about robot.txt because I am not really well versed with SEO yet. I am glad to encounter this discussion to broaden my knowledge with the search engine crawlers. My question now is the robot.txt is a necessity of the site otherwise the site will not be inspected by the crawler as if it is not updated with the contents because dormant sites are not checked by the crawlers. Correct me if I’m wrong.
    6 years ago
    1970-01-01T00:00:00+0000

    Are you sure you want to delete this post?