Seocheckout

Clear
Sign In Join

How would you prevent this?

  • angie828 Level X3
    • 4

    Write the reason you're deleting this FAQ

    How would you prevent this?

    Is there a way to prevent a spider from attaching itself to a URL that you do not want on the search engines?

    #spiders #search #engines Webmaster Related
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    robertman11

    robertman11

    Use your robots.txt file or use .htaccess to actually blog the spider (you can block by IP or by user-client).
    13 years ago
    1969-12-31T19:00:00-0500

    Are you sure you want to delete this post?

    Write your comment here...
    Light

    Light

    Thanks for the information guys. How would you prevent this?
    13 years ago
    1969-12-31T19:00:00-0500

    Are you sure you want to delete this post?

    Write your comment here...

    We use a range of cookies to give you the best browsing experience.
    By continuing to use this website, you agree to our use of cookies.