Reply to post: Re: It's nice to have regular recalls, but...

Robots.txt tells hackers the places you don't want them to look

Alister

Re: It's nice to have regular recalls, but...

I was just going to post the same thing, this is hardly a new revelation.

Any sysadmin who manages web servers has to balance the plaintive cries of SEO consultants (who want robots.txt) with those of Security consultants (who don't)...

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon