Re: What about...
Can you name any other platforms that allow this? If there are others, then yes, they too, should be investigated.
There are plenty of "guardrails" applied to LLMs and other "AI" tools that prevent all sorts of illegal uses, such as getting instructions on how to make bombs. They work with varying degrees of success.
However, here's the thing; in order to produce an "unclothed" image of a person, that "AI" model must have some source material that it has been "trained" on in order to do this. In other words, it has to "know" (and I use that word advisedly, because "AI" has no real knowledge) what the thing it is being asked to generate should look like.
At this point, the UK government should be asking Elon Musk how Grok can generate these images in the first place, what source material it has been fed with, and how they can be assured that, since its training data appears to contain material that is illegal in the UK, there is no risk that it will produce other material that is also illegal in the UK.
In other words, in extension to the adage GIGO (garbage in, garbage out), if there is illegal material coming out, there must have been illegal material going in, because "Grok" is not a conscious entity that can make this stuff up for itself.
If, for instance, it has been trained with images of naked ladies, so that its users can tittilate themsleves by asking it to generate an image of a naked lady, but it is illegal in this jurisdiction to make a pornographic image of a real person, then it stands to reason that the model trained with images of naked women must not be allowed to generate images of real people using that training data. Similarly, it should not be allowable to ask it to produce images of children based on that data. Personally, I think that if a person can use the internet and can't manage to find genuine images of undressed women, but instead have to resort to asking Elon Musk to do it for them, then maybe using any sort of computer is not for them. Perhaps a person finding themselves in this situation should also think about how objectifying women in this way might be the reason they are single and living in thier mother's basement amongst a pile of empty take-away containers and crusty socks.