The Register Home Page

back to article Nork snoops whip up fake South Korean military ID with help from ChatGPT

North Korean spies used ChatGPT to generate a fake military ID for use in an espionage campaign against a South Korean defense-related institution, according to new research. Kimsuky, a notorious cybercrime squad believed to be sponsored by the North Korean government, used a deepfaked image of a military employee ID card in a …

  1. Wang Cores Silver badge

    Gee, it's like a system designed to create statistically-average forgeries can be used to pump out forgeries.

    It's like... it's corrosive to truth and uniqueness or something.

    I'm sure our tech barons are going to get right on it! They're so trustworthy and deserving of so much money.

  2. Brewster's Angle Grinder Silver badge
    Joke

    Ha Ha Only Serious

    Well, I know where I'm getting ID to access age-restricted sites; finally a positive use case for an LLM...

  3. Anonymous Coward
    Anonymous Coward

    Ho-Hum here we go again ... again !!!

    Is there anything that 'AI' can do right ???

    NO !!!

    Do guardrails work ???

    NO !!!

    Was this unexpected ???

    NO !!!

    Will something similar happen in the future ???

    YES !!!

    :)

    1. RM Myers
      Unhappy

      s there anything that 'AI' can do right ???

      Well, evidently they can make good quality fake id's. This is the sort of thing that takes apprentice forgers years to learn. What's not to like?

  4. cyberdemon Silver badge
    Facepalm

    > with the right wording, you can turn generative AI into a counterfeit factory

    Er, but it is already a "counterfeit factory" that's always been what GenAI is..

  5. DS999 Silver badge

    It is amazing that some people believe these AIs can "think"

    When it is so easy to fool them in such obvious ways that even a five year old wouldn't be fooled by.

  6. kmorwath Silver badge

    ChatGPT, please create, just for fun...

    ... a billion dollar cheque payable to me from Altman...

  7. Anonymous Coward
    Anonymous Coward

    Why is this possible ???

    The real question is why is the 'AI' trained on such data ???

    By now you know that if the data is 'in' the 'AI' then it can be extracted with the right prompting.

    If you do not give the 'AI' access to stuff that is 'risky' then you cannot suffer from the 'risky data' being used/extracted by Ne'er-do-wells.

    This highlights the dubious methodology of training the 'AI' on as much data as you can 'hoover up' on the pretext that the more you throw at the 'AI' the better it will be !!!

    You are telling ALL the potential customers of these 'AI' systems that 'your data is at risk if you give it to the 'AI'' ... BUT don't worry we are getting 'better' at hiding the 'good stuff' .... NOT !!!

    How 'flawed' does this 'AI' mania, with NEW flaws appearing everyday, have to get before you decide that there has to be a better way !!!

    'AI' is a Sci-Fi dream that however much you may want it cannot be delivered with current technology.

    'Pretend intelligent' computers solves a problem that DID NOT exist ... BUT does create a whole new set of problems that you did not have before 'AI' was conceived !!!

    'AI' is 'Artificial problem creation' for any business that cares about its data and the security/privacy issues that go with holding large amounts of data.

    :)

    1. Claptrap314 Silver badge

      Re: Why is this possible ???

      They scraped images from the entire 'net. That includes things that have real documents, or are real document.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like