There is a reason I didn't focus on copyright in the article (which most commenters seems to have missed) - I am a privacy guy, I am more concerned with the privacy and data protection issues than the copyright issues; and yes I am perfectly happy to accept that others might be more concerned with copyright - and of course they are perfectly entitled to be - but as the author, my work will always be more focused on privacy than anything else.
If you read my previous article (referenced in this article) that much should be come very clear. I originally felt that deletion was the only possible way to deal with the issues (and even sent a legal demand to OpenAI to delete GPT3.5 as it contains my personal data) but as much as some people would be happy to just ignore the environmental impact of such a move - I am not. That is why it is an OpEd - it is my opinion and my opinion will always be more focused on privacy implications than anything else.
It is not possible to extract the personal data from the models (at least not yet), but those who broke the law by training their models on such data should absolutely not be permitted to profit from it (in my opinion).
Thanks for all the comments though, I read them all and will continue to do so as the day progresses.