back to article How 'AI watermarking' system pushed by Microsoft and Adobe will and won't work

Microsoft, Adobe, and other big names this week pledged to add metadata to their AI-generated images so that future compatible apps will flag them up as machine-made using a special symbol. You may have seen some reports about this perhaps described as some kind of AI watermark. We took a closer look. The symbol – described …

  1. Ken Moorhouse Silver badge

    Content Credentials Cloud

    That is going to be one hell of a repository of data, if everyone uses it. Can it support that size and bandwidth? Or will the data held there be of an abstracted nature, which is easier to circumvent?

    1. Phil Kingston

      Re: Content Credentials Cloud

      and who's paying for it

      1. Pascal Monett Silver badge

        Exactly. I don't see Adobe maintaining that Cloud out of the goodness of its heart - it doesn't have one.

        Plus, a verification system that you have to pay for wouldn't be used, meaning the check itself has to be free.

        Adobe doesn't do free.

        So how's it going to make the millions it is expecting from this ?

        1. Michael Strorm Silver badge

          "Pascal Monett is the author of this photo, as verified by Adobe ProfitProtect with support from our featured sponsors"

          (Meanwhile, the auto-play video superimposed on the top right of your image starts extolling the virtues of Clorets mints for fresh breath when you're on your next date).

          1. imanidiot Silver badge
            Windows

            Jokes on them, I never go on dates.

            1. Michael Strorm Silver badge

              No need to feel bad about that, I'm sure they'll give you the ad for hemorrhoid cream instead!

        2. Steve Graham

          It's a great database for training their AI.

  2. Henry Wertz 1 Gold badge

    It's a start

    It's a start. Every concern the article brings up is valid. But we're in a better situation having ai-generated images marked and someone having to know to remove them if they want to pass of the image as genuine, than the current situation of having no metadata indicating this at all. I'm sure given this spec just came out that more apps will gain support for it over time.

  3. DS999 Silver badge

    They have it backwards

    What we need are digital signatures on digital photos that can mark them as original. So I take a photo with my iPhone, it embeds a digital signature from Apple that says "this photo was taken by an iPhone", and probably some other metadata like the date and camera settings used. You want some stuff off by default that you could turn on like embedding your name and location for proof of copyright and so forth. Samsung phones would have its signature, professional cameras would have Canon's or whatever. So long as they keep their private key secure (you have it operate out of Apple's Secure Element / ARM's TrustZone / etc.) it would be pretty hard to dispute.

    Now sure you say photos are altered before publication, so what good does it do if an original photograph taken by an iPhone in Ukraine, for example, is modified before it goes on a website - even if all you change is scaling it to fewer pixels so it isn't huge and changing it from HEIC to JPG so everyone's browser can view it? But so long as they had the original photo they could make available in the event of a dispute - someone claims that photo is faked or photoshopped or AI generated or from 2014 - then it could be made available and the digital signature would check out showing the same scene proving it hadn't been altered, when it was taken, where it was taken, and who took it (if it was a press photo rather than from someone who feared retaliation and wouldn't have that identifier enabled)

    There's simply no way to tag all the AI generated photos, because if nothing else you can't control all the AI clusters in the world and make them obey such rules. So you have to attack the problem from the other end.

    1. IGotOut Silver badge

      Re: They have it backwards

      The thing is 99.99999% of professional photos ARE "photoshopped". That's exactly what it was designed for.

      1. DS999 Silver badge

        Re: They have it backwards

        Yes but like I say that's not a problem, because the original would still exist and could be made available as proof that it doesn't differ from the original in any material way if there was any dispute.

    2. katrinab Silver badge
      Meh

      Re: They have it backwards

      If they crop the image, adjust the exposure to make it more visible, then create multple compressed versions of it at different resolutions on their image server; that isn't faking it any more than taking text that someone has written and changing the fonts etc to your publication's house style. But it is probably enough for a computer to think it is a completely different image.

      1. Yet Another Anonymous coward Silver badge

        Re: They have it backwards

        There is a lot of AI between what comes off the sensor and what comes out if Apple/Google's image processing chip.

      2. SloppyJesse
        Joke

        Re: They have it backwards

        Store the original on a blockchain, each transformation is a transaction, the result is the published version.

        1. Alumoi Silver badge
          Joke

          Re: They have it backwards

          and sell it as NFT.

          Damn it, man, do I have to think of everything?

          1. Yet Another Anonymous coward Silver badge

            Re: They have it backwards

            Doesn't that only work for pictures of apes ?

    3. OhForF' Silver badge

      Hard to dispute?

      What would stop me from taking your picture and signing it with my metdata but a date a week earlier than you did and claim copyright?

      1. Jimmy2Cows Silver badge

        Re: Hard to dispute?

        What stops anyone screenshotting your picture, saving it without any signing, and sharing that?

      2. DS999 Silver badge

        Re: Hard to dispute?

        Not having access to Apple's/Samsung's/etc. private signing key. The only way a photo would be signed would be when it is produced by the iPhone/Galaxy/etc. You would have no way of making it sign something its image processor didn't output.

        1. Yet Another Anonymous coward Silver badge

          Re: Hard to dispute?

          Unless you photographed a print of the modified image with an Apple/Samsung etc phone

          1. DS999 Silver badge

            Re: Hard to dispute?

            Then the date and location encoded in the photo will be different from the original, and it isn't THAT hard to tell a real picture (especially outdoors) from a photo of a print no matter how high quality that print may be.

    4. garwhale

      Re: They have it backwards

      Sad to say, it's impossible to prove that the photo is yours via a digital signature. I can just take a photo of your photo with sharpening/upscaling, after setting the date/time of my camera to the past.

  4. Ace2 Silver badge
    Facepalm

    I’m sure the people spreading fake agitprop are going to be conscientious about applying accurate metadata…

  5. Neil Barnes Silver badge
    FAIL

    ...to bake the origin of pics into photographers' snaps.

    And what about the hundreds of billions of snaps already existing? Being unlabelled, they will therefore automatically be suspect.

    1. Anonymous Coward
      Anonymous Coward

      Re: ...to bake the origin of pics into photographers' snaps.

      ...which they should be.

      Why weren't you suspecting those before?!

  6. greenwood-IT
    FAIL

    So, if I create a deep fake porn image of a politician, I need to register that fake (with the CR) on the Adobe Cloud. Then when I share it online, obviously with the metadata removed, it can be detected. That sounds like it's going to work, and I can't think of any way around that :-(

    Also, if I grab a copy of an old photo of the Mona Lisa and upload it to the Adobe Cloud today, will that mark ALL global copies of the Mona Lisa as dodgy copies?

    This is going to be so much fun.

  7. Stephendeg

    All that investment…

    …and they think they have finally worked out how to sell it.

  8. Michael Strorm Silver badge

    Go along with this or someone else will steal credit for your work?

    > you upload your image files' metadata to Adobe's cloud; if one of your files is later shared by someone without its identifying metadata, whatever they are using to distribute the snap could run the image by Adobe's cloud and recover the metadata if there is a visual match

    So, unless you're willing and happy to go along with doing things Adobe's way and on their terms, someone else can be "first" to upload *your* image to Adobe's servers, claiming credit for themselves (*), so that you can then be accused of plagiarising your own photo by some automated corporate system that Facebook et al are using?

    Nice.

    (*) Don't worry, it's not like a big player in the market would allow this sort of thing to happen as long as there's money in it for them, right?

  9. Anonymous Coward
    Anonymous Coward

    It's obvious to any technically literate person that this is a load of nonsense that can never work.

    But the object of the exercise here is to create some wool to pull over the politicians eyes to prevent them from trying to regulate this technology.

    "Don't worry, we have a cunning plan that allows us to detect all fake images."

    Baldrick: I, too, have a cunning plan to catch the spy, sir.

    Blackadder: Do you, Baldrick, do you…

    Baldrick: You go round the hostipal and ask everyone, “Are you a German spy?”

    Blackadder: Yes, I must say, Baldrick, I appreciate your involvement on the creative side.

    Baldrick: If it was me, I’d own up.

    Blackadder: Of course you would. But, sadly, the enemy have not added to the German Army Entrance Form the requirement “Must have intellectual capacity of a boiled potato.”

  10. Omnipresent Silver badge

    uhhhhhh

    They can track you by pixel. By pixel.

  11. Anonymous Coward
    Anonymous Coward

    Vaguely reminds me of the (abandoned for now) UK ID card scheme.

    The one where immigrants and refugees would be issued with ID cards to show they were immigrants and refugees, but citizens not.

    It took millions of our money before the flaw was spotted.

    1. Anonymous Coward
      Anonymous Coward

      Re: Vaguely reminds me of the (abandoned for now) UK ID card scheme.

      The process of issuing the cards also took biometric data for the subject of the card. These included finger prints and facial recognition data.

      This meant that even if they threw the card away, they could still be identified as a non-naturalized person.

      I don't believe that this was ever abandoned. It's still used, and as far as I am aware, asylum seekers still get issued with these 'entitlement' cards.

  12. Jimmy2Cows Silver badge
    FAIL

    The coalition believes all this can help tackle AI-generated deepfakes

    WTF makes "the coalition" believe that deepfake producers won't immediately try to game this, or that the sort of people who willingly believe deepfakes are real without question will even give a damn?

    Oh right... the revenue this coalition thinks this vast repository will bring them. They don't actually care about deepfakes. It's just a land grab coupled with an extortion racket... "Nice images you got there... be a shame if someone deepfaked them because you didn't take advantage of our generous repository terms..."

  13. Snowy Silver badge
    Flame

    Helping themselves!

    Ai learning off Ai created images creates odd artifacts. They just creating something to stop the training data being polluted with Ai art, not to help anyone creating art the without Ai.

  14. Alistair
    Windows

    urmph

    I've just finished going through our photo/video collection from the last .... 28 years or so.

    Canon is stunningly reliable in the metadata it incorporates in the image, admittedly, timestamps can be off, and the GPS data didn't show up until the T series we have (2006?? i think). The blackberry stuff is solid, and the timestamps seem to be from the Cell network, and location data is down to 5 decimals. Other cellphones are pretty good, the exception being an LG SWMBO had that seems have had a permanent lateral shift applied to its GPS positions of about 8 or 9 degrees. I suspect it was clock settings not being correctly translated.

    There are *TONS* of metadata options for all imaging systems. And there is a *cough* standard for inserting it and modifying it. And there are dozens of applications that ignore it. After that my friends, image metadata is gonna fall down the "we already have 5 standards, and they're all incompatible" wormhole.

    The opensource community actually has a pair of tools specifically for removing metadata from images and ensuring that they cannot be traced or tracked back to the device with which they were taken or modified, as much for the journalists as for the other folks that need that.

    That there are a bunch of Mega(money)Corp entities trying to engender yet another controlling process on the General UnWashed, means one thing and one thing only, Its gonna cost you yet another monthly service charge to use it, as, since it is so valuable a service, the companies will be allowed to accept the income, and *not* pay taxes on that income.

  15. Adrian 4

    opt-out

    Why not put a visible watermark on the image and include an encrypted 'patch' to remove it. Then it's there in any non-conforming application but can be optionally displayed without in a conforming application.

  16. tiggity Silver badge

    Pointless

    For years I have often removed some metadata (if present) from photos

    e.g. lat / long data (don't really want a photo recording where it was* if it's my home address or nearby, strip that data out unless its a "holiday" visit (& nowhere near the places I usually visit))

    As a coding exercise I wrote myself a little app to edit metadata, but there's plenty of software out there that allows you to edit image meta data so trivial for people to remove metadata.

    And how is the content credentials cloud going to work - for an image search (to see if a cheeky metadata lacking version of an image exists) its going to need the image (or rely on very flawed image hashing) - so potentially massive storage requirements, and so likely to be a bit unworkable or a huge money pit (or they start charging people - which won't go down well).

    There's also the question of how similar an image match is... e.g. from same LLM I have had similar (but very slightly different) image outputs for the various prompts - so quite possible that could be multiple very similar images but with different "credentials" metadata - when essentially (almost) the same image can be created multiple times by people giving similar (or even the, same) prompts to "AI", then can also likely get some "ownership" disputes.

    Can cause even more chaos as many "AI" image tools allow you to suggest a starting image, and from output images allow refinement so using various methods can

    * Obviously some photos can be IDed if includes recognisable geographical feature (but that does not really apply to my snaps of family, friends & pets at home where location data defo needs removing for privacy reason)

  17. Dizzy Dwarf

    C2PA?

    Should've called it C2AP

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like