back to article Cerebras sets record for 'largest AI model' on a single chip

US hardware startup Cerebras claims to have trained the largest AI model on a single device powered by the world's largest Wafer Scale Engine 2 chip the size of a plate. "Using the Cerebras Software Platform (CSoft), our customers can easily train state-of-the-art GPT language models (such as GPT-3 and GPT-J) with up to 20 …

  1. Pete 2 Silver badge

    GIGO: the modern version

    > these models often exhibit the same biases found in their training data.

    What else would anyone expect?

    Bias in, bias out. Sad but inevitable. And the fault lies in the data not the AI.

    1. Harry Kiri

      Re: GIGO: the modern version

      It's not AI.

      It's just a transform from input to output. Potentially complex from a human perspective but just a transform. It models and represents only aspects of the training data.

      Personally I wonder about this, the researchers should understand the provenance, validity and scope of their data. If they're just using someone else's scripts to train a model (eg lots of 'researchers' use YOLO for image recognition as it has easy to use training scripts - but don't really know how it works ) then that is poor.

      So researcher doesn't know exactly what they're doing, identifies biases and thinks that is indicative of racism / sexism...

      No, this is quite poor and indicates a lack of understanding of machine learning and statistics.

      1. LionelB Silver badge

        Re: GIGO: the modern version

        Interesting: I myself am just an input -> output transformer (okay, with a bit more interactive feedback, maybe). I model and represent aspects of my training data (which I prefer to call "life experience") on the basis of my design (which I prefer to call "evolution"). And, try as I might, no doubt my output reflects biases in my training data. I accept this may be a design flaw.

  2. Pascal Monett Silver badge

    "one of three options"

    Only one of which is actually a verification. A video selfie ? Please. Do you have experts at detecting that that girl is actually 16 and not 18 ?

    No, you don't.

    And a friend's word ? Clue : it's their friend. They will lie to help their friend.

  3. Anonymous Coward
    Anonymous Coward

    "He undermines the responsible practice of AI science"

    These "experts" must go Unicorn hunting and post updates on Facebook. Responsible AI science... sure, sure, because that has been a thing this whole time as the data has been harvested from private people to train it, pot meet kettle.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like