Tackling potty-mouth chatbots to leaky LLMs. What's life like in Microsoft's AI red team?

Sometimes people want to abuse AI systems to leak corporate secrets. Other times they just want to force an LLM to talk like a pirate. Either way, it's the AI red team's job to anticipate how someone may try to weaponize these systems, and then help address those the issues. Ram Shankar Siva Kumar founded Microsoft's AI red …

[Dan 55]

It'd be interesting to know if Recall is a project that the AI red team was not invited to take a look at.

[Anonymous Coward]

AI

At this rate I highly doubt Recall will make it to production let alone integrating with AI in some way.

Given the friction between OpenAI and Microsoft - they are borderline frenemies - MSFT should red team the GPT family.

[tiggity]

Bio Weapons

When he was mentioning the various other experiences of some of the team he works with, I did quite a double take when he said one used to work in bio weapons!! (approx 12:12)

.. People who have been involved in such activities normally are supposed not to talk about it (unless the person was working in counteracting them rather than developing them, but even then tends to be big government gags involved)