back to article It's trivially easy to poison LLMs into spitting out gibberish, says Anthropic

Poisoning AI models might be way easier than previously thought if an Anthropic study is anything to go on.  Researchers at the US AI firm, working with the UK AI Security Institute, Alan Turing Institute, and other academic institutions, said today that it takes only 250 specially crafted documents to force a generative AI …

Page:

    1. Ken Hagan Gold badge

      Re: Retrievability

      So they've compressed all the bollocks on the internet to produce a machine that can generate similar bollocks on demand? Hmm. An interesting take on the matter...

      Has anyone put serious resources into training an LLM with only input from particular kinds of sources, such as the corpus of a traditional publisher? (The kind that use human editors for quality control.) Does an LLM weaned on scientific papers give accurate (and suitably cited) answers to technical questions?

  1. Bryan W
    Joke

    sudo shutdown now

    Fake news created by anti-AI terrorists. They just hate AI and make up reasons why it isn't simply THE BEST! We need to keep dumping ALL of our money into it so that all the rich tech billionaires can finally retire to their yachts orbiting the moon and the rest of ~~you meatbags~~ us can get back to killing each other over foodstamps.

    You are safe to move your business's entire brain trust AND data onto our AI platform so you can fire all these annoying needy and expensive ~~meatbags~~ employees. We swear we won't use such knowledge to allow competitors to outmaneuver you. Just like how we diligently made sure to compensate all those artist's IP we ~~stole~~ fairly used.

    Carry on. Nothing to see here.

    1. amanfromMars 1 Silver badge

      Re: Speaking Truth unto Power is Extremely Liberating and more than just Fabulously Exciting ..

      It's a shame that such as you have shared, Bryan W, [sudo shutdown now] is no joke. However it is indeed fortunate though that AI is not woke nor is its command and control of IT and QC [Information Technology and Quantum Communications] able to be taken for a cheapskates' expensive ride leading to anywhere where everyone and everything can all too easily be fooled and broken, time and time again.

      And the present historically established executive administrative systems that are all foundering and suffering both full frontal and underground virtual assaults, and against which they have no effective defences, don’t like IT up them for you can both see and hear them scream via the evidence of their disgraceful, dishonest and disagreeable pet mainstream media posts.

  2. Tessier-Ashpool

    Garbage In Garbage Out

    As more and more AI-generated content appears on the interwebby thing, I can see an existential crisis as it starts feeding its own crap into its training data.

Page:

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like