Re: It's nice to have regular recalls, but...
I was just going to post the same thing, this is hardly a new revelation.
Any sysadmin who manages web servers has to balance the plaintive cries of SEO consultants (who want robots.txt) with those of Security consultants (who don't)...