Re: And yet...
Moderation is an absolute nightmare to scale. You can apply dumb rules to everyone and you'll get a lot of false positives (c.f. anti-pornography filters blocking breastfeeding women). You can rely on report volume, but people can arrange for mass reporting (bot-driven or otherwise).
If you put humans in the loop to judge the context, those poor sods are getting a firehose of the absolute worst content (a terrifyingly wide range of that, from violent crimes in progress to genocide recruitment ads like Myanmar down to aggressive grifters scamming the elderly out of their savings, snake oil salesmen trying to get kids to drink bleach - you really can't understate how much horrible crap there is on the internet), often without any counterbalance to maintain their mental health. The list of ways _that_ can go wrong is extensive.
As none of this generates income, it's not going to get funded well, and without that funding, with out enough eyes and without the support they need to do the job and stay sane: the whole thing is an ethical minefield, and one the big social networks appear to be tap-dancing through in hoiking great clownshoes.
Biting the hand that feeds IT
