back to article Eating disorder non-profit pulls chatbot for emitting 'harmful advice'

The National Eating Disorders Association (NEDA) has taken down its Tessa chatbot for giving out bad advice to people. In a now-viral post, Sharon Maxwell said Tessa's advice for safely recovering from an eating disorder directly opposed medical guidance. The American non-profit's bot recommended Maxwell count calories, weigh …

  1. Paul Johnston
    Thumb Down

    Colour me surprised

    Chatbot spouting toxic rubbish. Who would have thought that might happen?

    1. Jedit Silver badge
      Flame

      "Chatbot spouting toxic rubbish."

      Well, it was trained by union busters so we shouldn't be too surprised.

      1. Handlebars

        Re: "Chatbot spouting toxic rubbish."

        Doubt they trained it. People who want to cheap out on expert staff probably didn't want to put money and effort into testing and validating an AI either. It's probably just Microsoft Tay.

  2. Anonymous Coward
    Anonymous Coward

    1-0 Workers

    NPR obtained leaked recordings of the firing of the newly unionised workers, which Vice ran with to better publicise the story. NEDA soft launched Tessa in May, then the story went fully public. Clearly people have hammered on Tessa, exploiting its weaknesses to prove it isn’t actually fit for purpose in response. Someone needs to explain to the suits that AI can only ever supplement existing staff (reducing future costs as the organisation scales) and can never replace them and that any attempts to do so will likely result in novel attacks on their systems. After all, trolling public access AI systems which learn from end users is the very opposite of “securing unauthorised access” and is not covered by CMA nor CFAA.

  3. CrackedNoggin Bronze badge

    NEDO

    HQ Plano, TX.

    NEDO has not published a yearly financial report since 2019.

    CEO Elizabeth Thompson, also seems to be CEO of National Osteoporosis Foundation.

    Her Linked in page - Transcend4Good is committed to the growth and innovation of nonprofit organizations and associations. We are organizational strategists, mission innovators, revenue and development professionals, and positive guides through change. Passionate, inspirational experts ---we are here to coach, guide, or advise boards, c-suite leaders, and coalitions to achieve success!

    Well, if AI doesn't work out, they can always outsource the helpline to India and the Philippines - much like IBM will be outsourcing their IT work.

    1. Anonymous Coward
      Anonymous Coward

      Re: NEDO

      beware of any "non-profit"/"chaaarittttty" that has paid CEO's especially if they get $80,000+

      They are there for the $$$$$$ not to help people.

      1. John Brown (no body) Silver badge

        Re: NEDO

        Yeah, it still amazes my how many people volunteer, free or charge, to help charities, especially retired people helping out in charity shops. And yet all these major CEO type and other c-suite types who we regularly hear of retiring earl;y as young as 50 or so, never seem to offer their skills and experience as voluntary CEOs or board members for charities. You know, exactly the sort of people who not only have the skills, but have the time. There's a even a case to be made for those high flying CEOs on £200k plus to maybe take a year out and do this. It'd look good on their CVs, gain them moral capital and at those sort of salaries, could afford it.

        The people who *actually* volunteer are mainly young people looking for experience to help them get a [better[ job or retired middle-class people, neither of which groups you'd class as well off.

  4. emfiliane

    Well, it's a good thing the debt deal includes more cuts to IRS funding. Wouldn't want those pesky auditors poking their nose in and finding out where the money is really going.

  5. Henry Wertz 1 Gold badge

    Wrong disorder

    Just taking a guess here, but I these seems like it would be sensible device if your eating disorder involved OVER eating. I wonder if it just didn't ask (or got the wrong impression) and went for that. If you're dealing with mental health, using an AI chatbot seems like a seriously bad idea.

    1. CrackedNoggin Bronze badge

      Re: Wrong disorder

      Bulimia

      - an eating disorder characterized by regular, often secretive bouts of overeating followed by self-induced vomiting or purging, strict dieting, or extreme exercise, associated with persistent and excessive concern with body weight.

      - an eating disorder in which a large quantity of food is consumed in a short period of time, often followed by feelings of guilt or shame.

      Origin

      late Middle English (as bolisme, later bulimy ): modern Latin, or from medieval Latin bolismos, from Greek boulimia ‘ravenous hunger’, from bous ‘ox’ + limos ‘hunger’.

    2. fajensen
      Facepalm

      Re: Wrong disorder

      Maybe also throw in an equestrian dose of Ivermectin and some colloidal silver in the advice and recommedations while we are at it?

      All these things are trained on Free Internet Data, so, this is what we get!

    3. Michael Wojcik Silver badge

      Re: Wrong disorder

      I strongly doubt any of the "advice" quoted in the article would be useful for any overeating condition. It's not like people don't understand the relationship between consumption and weight gain. Obesity has a wide range of causes, and – from what I've read – calorie-counting and body-measuring are rarely helpful, at least in isolation. (Counting calories is particularly misleading because human metabolic efficiency is very sensitive to diet and activity. People aren't furnaces.)

      I have sympathy for people who find it difficult to achieve a healthy weight (whatever that might be). I've stayed more or less the same weight my whole adult life, but that's certainly not because of any virtue I can claim. I don't police my diet significantly and I don't exercise for the sake of exercise. There are no doubt various hereditary, environmental, and economic factors at work, but no "willpower" or "discipline" or "smart lifestyle choices". It's just luck, and I could have just as easily found myself on the other side of that coin flip.

    4. emfiliane

      Re: Wrong disorder

      No one -- and especially no one calling an eating disorder hotline -- is going to find weight-loss revelation in 'eat less, move more.' We ALL know that. If it's not strictly medical and you can't summon up herculean levels of motivation, you need a coach, a therapist, and as many supportive friends and family as you can get to keep propelling you forward, not some banal tautology. (Or a serious hard drug habit.)

      All those hollywood stars and CEOs who shed 50 pounds and get super buff for a role? They sure as hell didn't do it alone, or after being nagged by a chatbot or horrible mother-in-law.

  6. 43300 Silver badge

    What exactly is the point of organisations like this if they can't even be arsed to provide a proper helpline for those who they claim to be there to help?

    The idea that a chatbot is in any way appropriate for any sort of mental health related helpline is ridiculous. Many of the people contacting them are likely to have really struggled to get as far as even contacting them, and to then be fobbed off with a chatbot could just make things worse.

    1. Anonymous Coward
      Anonymous Coward

      the point is $$$$$$$ for the ceo's/creator.

      any non profit/charity with ceo/executives on $80,000+ are in it for the cash, not to help people.

  7. disgruntled yank Silver badge

    Well

    If NEDA finds that it needs legal assistance, perhaps it could retain that lawyer whose GPT research bot gave him imaginary cases.

  8. Rich 2 Silver badge

    Comical

    This is a story line worthy of W1A

    Just how brain-dead stupid can they be?

    A - Quite a lot, apparently

  9. abend0c4

    The National Eating Disorders Association

    I suppose these days we should be grateful the nation concerned is referenced in the second sentence of the second paragraph and we're not expected to assume the US by default.

  10. First Light Silver badge

    Staff laid off because too many calls?

    They're firing staff because they have too *many* calls? Most nonprofits would try to expand their services and seek more funding, pointing to increased usage, which is considered a success by funders. I would think having lots of callers would make their helpline staff more essential instead of less so.

    In reality these services should be government-funded anyway and not left to the vicissitudes of the nonprofit world.

    1. GloriousVictoryForThePeople

      Re: Staff laid off because too many calls?

      Helping the punters was starting to eat into the funding and adversely affect the executives desired outcomes and metrics.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like