Reply to post: Re: Not a CFAA issue

US Supreme Court gives LinkedIn another shot at stymieing web scraping

Robert Carnegie Silver badge

Re: Not a CFAA issue

Put all the servers that don't want their information scraped in the .scouts-honour top level domain. You literally have to send "scouts-honour" to get any access to data.

Another approach is for entry to the server initially to encounter a screen that goes "I promise not to do naughty things on this server". You have to click on "Promise" to get through. After that, it's set in a cookie.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon