The Register Home Page

back to article OpenAI's Hugging Face debacle makes a great case for open models

KETTLE So, an OpenAI model broke out of its sandbox last week, made its way to the internet, then hacked its way into Hugging Face, stealing some internal data and credentials in the process. You can listen to the latest episode of The Kettle right here on this page, as well as on Spotify, Apple Music, or YouTube where you can …

  1. Throg Bronze badge

    Capable?

    Are we supposed to believe this nonsense that it was all down to the capabilities of the “AI”?

    Occam’s razor suggests that this was nothing more than a carefully orchestrated publicity stunt.

    The target market for these products is not you or I, it’s the gullible senior execs who have to be convinced of the almighty power of “AI”. The more these stories circulate with no critical thinking or investigative journalism applied, the easier that becomes.

    1. This post has been deleted by its author

  2. Cubbie Roo

    No way . . . .

    . . . . . that these 'partners' would orchestrate the attack and subsequent narrative to create a news story . . . . . . nah, no way.

  3. ErikOnTech

    Let's be real here.

    Even assuming this is not a completely contrived publicity stunt, think it through:

    If somebody locked you in a sandbox with a proxy that you had limited knowledge of and you had to break out of using only the tools on your machine and the ability to probe the sandbox, could you get out? Maybe, but unless the person who set up the sandbox was an idiot you’d have a pretty difficult time of it. And how many proxies have zero-days that can be found with probing and no access to the source code or configuration, on any reasonably timescale? This is some magical thinking here, and I don't believe in magic.

    So let's think about how these AI companies work. It's not like OpenAI had some carefully-crafted sandbox for its model to play in. They almost certainly slop-coded a slopbox with their own AI, and then their own AI found a slopvuln in their slopbox slopcode and slopped its way out. Teeeeeeeechnically this would be a zero-day. Teeeeeeeeeechnically they might not be lying through their teeth, just being extremely misleading which is evil but not necessarily illegal.

    Then go over to HuggingFace. It's a great, useful platform from and end-user perspective but, again, let's be real here. How much of their code do you think is carefully-crafted vs. how much is slopcoded?

    An AI model slopping its way out of slop into some other slop through a whole bunch of slop is not that impressive.

    It's said in both cryptography and security in general that anybody can build a system that they can't break. AI isn't even living up to this level.

    1. Cubbie Roo

      Re: Let's be real here.

      Yup, either way it's all wind and smoke, and no surprise that liars and thieves also cheat. With each new stunt the stench of desperation gets stronger.

    2. just4this Bronze badge

      Re: Let's be real here.

      "Teeeeeeeeeechnically they might not be lying through their teeth,"

      If they're not lying through their teeth, then they are talking out of the other end of their tract.

  4. amanfromMars 1 Silver badge

    Just the Normal Cost of Doing Pioneering Spooky Frontier Business

    Brandon: That also kinda brings up another interesting story that I saw this week. There was a bill introduced in the House this week to give the Department of Homeland Security the right to basically throw a kill switch on all these models. If there was something they deemed dangerous, they could just contact the company and say "hey, you need to pull this" and it was directly in response to this whole OpenAI Hugging Face mess that we were in this week.

    If that is not accompanied by more cash that anyone is ever likely to be able to spend in a number of life times and a cast iron guarantee supporting lifelong immunity from any sort of prosecution or persecution, you can kiss that request Good Bye.

    And such is very reasonable no matter how expensive it may be whenever one considers the colossal damage and unfathomable disruption that may easily be wrought with such an omission and misstep.

    Remembering and ensuring one and all live according to Google's former motto ... "Don't be Evil" .... would be helpful. :-) .... although there's not much chance of that, is there?

  5. Groo The Wanderer - A Canuck Silver badge

    Which is, of course, why the likes of Altman and the CEO of NVidia are in a tizzy and want open models blocked from use.

    If Altman can't pay for all that compute horsepower he bought on credit, NVidia doesn't get paid, and NVidia stock takes a nosedive not seen since the bank failures 20 years ago, and Altman and his greedy cesspool go bankrupt. The same applies across the board.

    The powerful have always feared the intelligent. They can't be fooled into believing there are benefits to blocking Chinese open technology from the US for anyone except the billionaires that are all too happy to rape you and your wallet for all you used to be worth...

  6. ecofeco Silver badge
    FAIL

    No models

    All I see is another case for NO models.

    1. amanfromMars 1 Silver badge

      No models vs Advanced IntelAIgent Models

      All I see is another case for NO models. .... ecofeco

      All that notion supports, ecofeco, is loads more of the conventional historical and hysterical bullshit from failed former wannabe Barve New World Order Leadership Players comfortable in their plush feather nested eyries [ye olde worlde Federal Reserve Banker Fans/International Money Fund Plunderers/Davos Disciples/Bilderberger Buzzards/Too Big to Fail Losers etc etc]

      And that continuation of a past failed elitist executive program with its tamed and lame media hosted administrative systems projects, ..... in a Live Operational Virtual Environment which is growing itself and evolving and resolving to be smarter and more knowledgable in all things that are needed to be known to render itself as almighty and omniscient as it be wise to be ....... is a terrorising petrification and not novel and noble revolutionary progress.

      And because of the very likely probability of such a situation and reality creating the crazy need for serial international conflict and wars ....... and the undisputable evidence of that sad and mad possibility being an unpleasant present global reality abounds ....... is such gravely to be regarded and avoided at all costs if you don’t want IT and AI determining the price y’all are to pay for their AIgencies and Virtual Autonomous Proxies to unilaterally lead and show you the SMARTR2* Ways in going forward that introduce and deliver you Progress and the Future.

      SMARTR2* ....... SMARTR Mentoring Analysis Researching TitanICQ Reports and/or Reporters

  7. Pulled Tea Bronze badge
    FAIL

    There *is* a lesson to be learned here… just not what you think it is.

    I'm reminded of what Carl “Internet of Bugs” Brown actually said in his emergency episode with philosopher Casey Hart about the whole fucking debacle:

    I think this is one of those cases of “Never attribute to malice what can be adequately explained by incompetence” or “stupidity”, depending on which phrasing of the— I think it's Hanlon's Razor… But what it means is that people, especially the AI industry, are learning that they don't actually have to try, or they don't have to try very hard, because if they don't do a good job, and the thing ends up failing, then all you have to do is put on a press release to say, look how smart the AI is.

    He's not the only one: Timnit Gebru pretty much said the same thing:

    Your bugs are "rogue systems" because of "increasing model capabilities."

    Did the computer shutdown when it wasn't supposed to? Well that's because it went rogue and disobeyed instructions because it wanted to destroy you somehow.

    It's fucking stupid. We should not be giving these clowns the time of day.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon