Those Anthropic "Claude" bots are intrusive, they ignore robots.txt directives (most bots except legitimate search engines do), and abusive. I started noticing them back in May, hammering the shit out of my web forum and photo gallery. We're talking like 400 to 500 simultaneous bots all coming from different IP networks within Amazon's cloud.
If AWS is going to allow that kind of tomfoolery to take place on their network, fuck em. I have blocked every single CIDR block used by AWS with kernel rules. We're talking /9, /10, /12 bit subnets etc., millions of IP addresses. I don't have to care about that, for there are no internet clients (butts in chairs with web browsers) in there. I've been thinking of dropping the rules to see if they were still a problem, but... nah. AWS can stay blocked.
It's no joke, I like to allow large publicly viewable attachments and gallery posts for my members, and these asshole bots rack up tens of thousands of downloads.
It's not even that I mind the content being scraped, it's the bloody abuse.