back to article Bumble open sources AI code to automatically blur NSFW photos

Bumble has open sourced an AI image classifier model designed to automatically blur nude pictures sent on its dating app. The tool, dubbed Private Detector, was launched on Bumble in 2019. If it detects fleshy skin tones and characteristic shapes of sensitive body parts, the model blurs out the image to prevent a user from …

  1. RichardBarrell

    I hope Bumble rent out that model as a service, because pretty much every online communication service in the world currently has a cyberflashing problem.

    1. tony72

      I remember hearing about an AI tool that does effectively the opposite, used to de-censor Japanese naughty movies. AI battle?

      1. Yet Another Anonymous coward Silver badge

        But to train that you would need a large data set of images of people's sproingfangles and kerflumpunkitz

        Where would you get such things ?

        1. JohnTill123
          Trollface

          Where would you get such things ?

          Pretty well anywhere on the Internet.

        2. Aussie Doc
          Joke

          Well...

          ...obviously from the same supplier that makes the KOMPUTERMASCHINE with the BLOWENFUSEN, POPPENCORKEN MIT SPITZENSPARKEN and associated software.

    2. Anonymous Coward
      Anonymous Coward

      I must be doing something right (wrong?), because I never see such images.

      1. stiine Silver badge

        The answer to your question depends on why you're on the internet. No, I'm kidding, You're doing something wrong.

  2. Death Boffin
    Headmaster

    Art class

    That generative AI uses previous artists' work to make images does not appear to be any different than any human art student. They study the Masters' techniques, styles and composition to produce their own art. The fact that there is a genre such as Anime shows that some amount of intellectual property has been copied from one place to another. But if a computer does it, it is different for reasons.

    1. Jason Bloomberg Silver badge

      Re: Art class

      But if a computer does it, it is different for reasons.

      I guess it comes down to perceived skills and talent when performing in someone else's style, against those needed to get a computer to do the same.

      I don't personally understand the vitriol directed at bg_5you. Nothing wrong with reasoned "you shouldn't do that", explanations as to why "that's not a good or appropriate thing to do", even "that's crap", "an insult", but the backlash goes far beyond that.

      IMO there's far too much "with us or against us" polarisation and tribalism these days. We are increasingly losing our tolerance of others and that's not a good thing.

      1. This post has been deleted by its author

    2. JDX Gold badge

      Re: Art class

      Even in human circles, trying to make work you can pass off as a famous artist is considered poor form, so no it isn't different in that regard.

      A human who tries to create art in the specific style of another has to put in a lot of work. They must study their muse's works and learn in great detail the exact style and technique of the artist, before spending a great deal of time honing their skills. This is very different from an AI training set, so that's "reasons".

      A typical human student does not however try to do that. They learn from great artists and borrow techniques which they apply to their own passions, or they blend styles from multiple artists or come up with something totally new.

      1. Version 1.0 Silver badge
        Happy

        Re: Art class

        I haven't attended an art class for nearly 60 years now but originally, as a kid, I was drawing nude males (naked civil servants) and females - I'm not Quentin Crisp but I grew up in that world occasionally. So these days I still see clothes as just draped over a body that my early work predicted ... as a result I have no interest in nudity because there's nowhere I can't see it, regardless of what anyone (LOL or any politician) is wearing.

        1. stiine Silver badge
          Alert

          Re: Art class

          Holy hell, don't tell the prudes that.... you'll ruin it for all of us.

          1. Version 1.0 Silver badge
            Alert

            Re: Art class

            Sure, I never mention it face to face with anyone ... I agree with your thoughts, I think most views of nudity are stupid but they are just views with no experience so people can have those opinions even if I disagree because of a different history and working environment.

      2. Yet Another Anonymous coward Silver badge

        Re: Art class

        > The fact that there is a genre such as Anime shows that some amount of intellectual property has been copied from one place to another.

        So the large eyed young ladies of Japanese/Korean anime aren't related to Disney large-eyed cartoon figures

        1. Death Boffin

          Re: Art class

          I will only ask, correlation or causation?

          1. Sora2566

            Re: Art class

            Causation. The first ever anime and manga - The Mighty Atom, localized over here as Astro Boy - was directly inspired from Ducktales comics.

      3. Nick Ryan Silver badge

        Re: Art class

        Computer generated art has been ongoing for some time. Creating a collage and post-processing it is nothing more than an inevitable progression.

        Is this plagiarism or inspiration? Is a human applying an "oil painting" preset to an image plagiarising those who can paint in oil? How about a robot that has been programmed to paint using oil based on an image (this happened quite a few years ago).

        How about someone applying a lot of post-processing and image merges in photoshop to enhance a photo they took, adding or changing the sky? Is that art or not?

        The problems are not about the use of tools, which is what computers are and the marketing BS of "AI" aside, they are still just tools. The important dividing line is where something is passed off as something that it is not. Does it really matter if a computer generated an image or not? Claiming that it was generated by a human, let alone a specific human, when it was not is where the line should be. Similarly claiming that a heavily manipulated photo is real is wrong too, it may be lovely and a work of art but it is not a photo anymore, it's a piece of art.

        The spittle sprayers who claim that it's wrong for a tool to be able to mimic an art style are completely out of touch with reality. How do they think that animated movies are made to look in a particular style? By individual hand drawn cells?

        Computer generated music will come along soon enough too, and we'll have the same old arguments rolled out again about how a computer shouldn't be allowed to create music. They are tools, nothing more.

  3. Anonymous Coward
    Anonymous Coward

    Schmidt Futures said ....

    ... 'the current adoption of AI in STEM subjects in academia is "slow" and resources and expertise is "unevenly distributed."'

    (a) It does not appear to be especially "slow" given what I see when looking through research job ads here in the UK, and (b) you aren't going to fix "unevenly distributed" by throwing money at all those top "usual suspects" institutions.

  4. Mike 137 Silver badge

    The new normal?

    "he received death threats after he shared a model he had trained to produce images in the style of the late graphic South Korean cartoonist "

    Not only does common sense seem to be even less common than previously thought, but any sense of proportion appears to have gone missing too. <satire>Thank the Vulture that we're all pseudonymous here. Otherwise the ranks of commentards might well be decimated within a week.</satire>

  5. tiggity Silver badge

    Obligatory BlackAdder reference

    "If it detects fleshy skin tones and characteristic shapes of sensitive body parts"

    <Baldrick>Does it recognise sensitive body parts shaped like a turnip?</Baldrick>

    1. Yet Another Anonymous coward Silver badge

      Re: Obligatory BlackAdder reference

      Or misses normal shaped body parts coloured like a turnip

      1. JDX Gold badge

        Re: Obligatory BlackAdder reference

        "Bumble has blurred this image because we think the subject is not very pretty. Click to see the unblurred image".

        1. Anonymous Coward
          Anonymous Coward

          Re: Obligatory BlackAdder reference

          Speaking admittedly as a man, but ladies I have been acquainted with have always considered the trouser protuberance from a strictly 'function over form' perspective.

          Do even gentlemen who enjoy the company of other gentlemen consider the 'sceptre of one's manhood' of intrinsic prettiness ?

  6. Schultz
    WTF?

    Alternative ways to "make the internet a safer and kinder place"...

    is to get everybody (including kids) used to the naked human body.

    Seriously, I never quite understood the stigma associated with human nakedness. In the West, showing too much leg is considered risqué, whereas in Asia you have to cover up your shoulders. And if we cast the net a bit wider, we can find that showing female hair or eyes is way to revealing, or that exposed breasts and even full nakedness is quite normal.

    Back in the days of my PhD, it took the US students exactly two trips to the sunbathing beach (Zürihorn) to realize that the female form is quite ordinary. (Don't look it up, nobody is excited to encounter your misplaced curiosity.) Made me realize how prudish our US cousins are; the locals had stopped staring a long time ago.

    The rules about decency are quite arbitrary. Let's change the rules.

  7. Anonymous Coward
    Anonymous Coward

    Why would an AI copying a style (after analysing the artists corpus) be a breach of copyright, when it's not if a human copies a style (after analysing the artists corpus)?

  8. trevorde Silver badge

    Accidentally blurred

    my picture of a baby's arm holding an apple

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like