Re: I don't understand
robots.txt says which places you shouldn't visit but should also contain decoy areas that just fuck about with any robot that goes there. If you know how to monitor load from a page you can really piss them about when you have some spare grunt to keep them amused.