Microsoft 365 tries again at filtering swearing, bad behavior: Classifiers for seven languages offered

Microsoft has gone back to the drawing board and once again emitted tools to detect and filter out swearing and abuse on its Microsoft 365 cloud. News of the profanity protector popped up on the Microsoft 365 Roadmap, a feed of information from Redmond about new features coming to the tech giant's sprawling subscription …

[b0llchit]

A textual salute

I salute the whole concept with a choice of fingers shown on both hands, where the choice of fingers probably will fall on a couple of centrally positioned fingers, extended upright, while the others are folded back into a fist-like structure.

[NATTtrash]

Re: A textual salute

Clippy: I see that you're pretty pissed off. Do you want me to suggest some safe terms to continue bitching, or would you rather like me to report your language to Nanny?

[Joe W]

Re: A textual salute

Ah, you mean "the ancient sign to ward of demons"? (T. Pratchett, "Interesting Times").

[deadlockvictim]

US-centric

And, of course, all of the decisions made will be US-centric.

Over this side of the Pond, cunt is an everyday swearword, not especially sexist, strong but not very strong, and rarely used in its original context. Usually it means that the fellow working with you has fucked up or has made you angry. It is mostly vernacular though.

In the US, however, it has become The Most Evil Word Ever™, presumably because of their Puritan history.

Of course, now I will have to think of a way to incorporate cunt in a Microsoft document.

What do I know about Scunthorpe? There is surely a cunning stunt I can pull.

[Evil Auditor]

Re: US-centric

Consider this: you oppress religious fanatics. They leave and find another place to fuck up and they grow and breed. Many -severel hundred- years later, just about when you thought that you overcame moral constraints and finally live in a liberal society, they come back at you telling you what you can say and what you cunt.

[martyn.hare]

They also hate people with Cock as a surname

I had to turn off their profanity filters (which are useful for blocking viagra spam) because it couldn’t differentiate context. Microsoft support was useless as usual and it was down to me to find out why emails were not being received.

For all their touting AI you would think they could check if the word is part of the From line tagged in an email body due to people replying/forwarding... but no... their stuff is completely SHIT* as to be expected!

* Stupid Hassle Irritating Techies

[IGotOut]

Re: US-centric

"Over this side of the Pond, cunt is an everyday swearword, not especially sexist, strong but not very strong, "

You'll find it varies from region to region and age tonagr in the uk.

My guess is you live in the South East.

[deadlockvictim]

Re: US-centric

Dublin, actually.

[NeilPost]

Re: US-centric

Do you not mean in cunting Dublin

Fecking hell !!

[Michael Wojcik]

Re: US-centric

In the US, however, it has become The Most Evil Word Ever™, presumably because of their Puritan history.

I don't think the Puritans have much to do with it. They were actually pretty liberal when it came to talking about the naughty bits, and for that matter about using them. Some studies of their records suggest a majority of women were either pregnant or had children by the time they were married. And it was customary, at least in some communities, that if an eligible bachelor stayed overnight with a family that included an eligible daughter, the two would sleep together; we have various documents substantiating that.

What did happen in the US, but in the eighteenth and nineteenth centuries – well after the Puritans had become no more than a relatively minor (if wildly overrated) chapter in US history – was a long-lasting panic over any mention of female anatomy. Bryson (yeah, I know, but he cites reliable sources in this case) discusses it at some length in his book on US English. It was so bad that serious medical conditions often went untreated because women couldn't describe their symptoms to doctors.

The reasons for this are unclear, but they probably have more to do with social climbing and attempts to delineate class structures, which historically have been nebulous in the US, than with leftover Puritanism.

Things are improving, though. Why, in the states covered by the 10th circuit, women can go topless in public now. They pretty much never do, but they can, at least anywhere men can. (Businesses, for example, can require shirts for everyone.) The day may yet come when we're not stricken with horror at the prospect of our own bodies.

[Ken Moorhouse]

minimize comm risks by helping you detect, capture, act on inappropriate messages

What about a lawyer, sending verbatim evidence regarding a court case?

Is MS o365 going to be allowed to mangle it?

[Anonymous Coward]

Re: minimize comm risks by helping you detect, capture, act on inappropriate messages

I was about to post something similar. Can this be turned off by the user, perhaps on a per-document basis, or is it something which is set centrally by an admin?

[Danny Boyd]

Re: minimize comm risks by helping you detect, capture, act on inappropriate messages

It's like spell-checker, you can turn it off or ignore its warnings.

[aks]

Re: minimize comm risks by helping you detect, capture, act on inappropriate messages

Somebody would have that authority. What's the chances it isn't you?

[Anonymous Coward]

Re: minimize comm risks by helping you detect, capture, act on inappropriate messages

The manual says you must wrap it in double quotes.

[Martin an gof]

Multi-language documents

So, if you have this setting on by default (I am assuming you can turn it off?) but happen commonly to write documents containing a mix of languages, supported and unsupported, what happens then? I already have issues with the spell checker assuming that a whole document is in the same language...

M.

[Chris G]

Re: Multi-language documents

The Thought Police on outlook constantly drive me nuts with spelling and grammar suggestions, I regularly mix English and Spanish in emails.

It goes totally wonky if I add Russian.

I haven't seen a way to turn it off.

[Anonymous Coward]

Re: Multi-language documents

Try Teams. It keeps asking you "Are you writing in English now?" or "Are you writing in Spanish now?" and sometimes it even grabs the focus. As far as I can tell there is no "fuck off you cunt and don't bother me again" button.

[MiguelC]

Re: Multi-language documents

That!

I write documents that regularly mix Portuguese, Spanish, French and English (well not all at once, but at least two or three), sometimes within the same sentence, and Word always loses the plot and throws hissy fits...

Also some grammar rules fail regularly (eg. using consecutive homographs is relatively common in Portuguese) and there's no way of excluding those particular repetitions

It's so bad I just turn spell checking when reviewing the document and ignore most flagged errors and suggested corrections.

[Neil Barnes]

Call me optomistic

but I can really see this working well... no, wait... no, it'll work almost as well as the grammar. It will assume that people didn't mean what they typed, and try and dress it in the latest flavour of fashionable newspeak.

Suggesting alternative spelling for words it thinks are misspelt is fine, provided there is no auto insertion of corrections (look at the amusement that can be had with autocorrect on a phone, for examples) - but that is where it should stop. No machine should *ever* replace what the operator writes...

If you, as a company, have a problem with the way your employees communicate, the issue is one of education, not of farming the problem out to software.

/rant

[Big_Boomer]

FAQing Tw@ts

Whilst I can understand detecting bullying and abuse, the use of so called swearwords often also indicates stress and dissatisfaction. Will the companies that implement this actually read and act upon such emails or will they just use it as one of the excuses to get rid of the "troublemakers"?

I have never understood the classification of words as good or bad. I can insult someone deeply enough that they never speak to me again and do so without using a single swear word. Words are just words, tone and context are far more important than the specific words used.

[John Sturdy]

Perhaps we can learn from the past...

Perhaps we can learn from the past... and revive some Shakespearean insults that it doesn't know about? For its sin’s not accidental, but a trade.

[deadlockvictim]

Re: Perhaps we can learn from the past...

You base football player!

[Diogenes8080]

What fresh hell is this?

I will be interested to see what is finally offered, but:

US products are often notoriously US-centric but sold as-is to other English-speaking nations. Never mind about different cultural values and the resulting false positives; these dictionaries will miss a lot of unpleasant local vernacular that could potentially get your senders in trouble. If you work in healthcare, also beware these dictionaries picking up "clinically correct" expressions.

A lot of Eastern European profanity is, I understand, euphemistic and only profane in context. It would take a fairly impressive AI to get that right. Other languages may pose similar problems.

As other posters have pointed out, legal and HR teams often need to handle statements verbatim. You can typically exempt their mailboxes, but that leaves them unscreened and what about shared storage? In personal communication, what is acceptable amongst friends is not so acceptable from enemies and strangers. Again, it's a matter of context.

You have a hit. You, or an automated rule, tells the sender / author not to. It doesn't take long for that person to adopt obfuscation, after which you are in a labour-intensive and ultimately fruitless loop as the possible permutations spiral beyond your product limits. Alternatively you can drop / delete / quarantine the content and create a support burden there instead.

[Evil Auditor]

Re: What fresh hell is this?

Eastern European profanity, such as a mother caringly saying to her daughter: «jebo ti pas mater»

_{I'll leave this to your preferred translation service...}

[Anonymous Coward]

@Diogenes8080 - Re: What fresh hell is this?

I'm native from an Eastern European country and I can attest to that. Simply saying the words 'Your mother' to someone can be a serious insult. It's all in the context, the tone, the accent and even your facial expression can make the difference. And there are at leaset 2 or 3 variations of the word mother you can chose from in order to vary the intensity of the insult.

Frankly, I find swearing in Western languages to be pretty mild and lacking imagination.

[veti]

Re: @Diogenes8080 - What fresh hell is this?

Well yes, saying "your mom" in American can be pretty insulting too.

[Michael Wojcik]

Re: @Diogenes8080 - What fresh hell is this?

Saying "hello" can be pretty insulting. It's all¹ in how you do it.

¹Well, all except diction, by definition.

[John Sturdy]

Profane by context

A classicist friend once told me that every Ancient Greek word has three meanings: its literal meaning, the opposite meaning (for ironic use) and a smutty innuendo. I wonder if the filters try to remove *all* the words that could be smutty.

The position of the lioness on the cheesegrater is still a bit of a mystery, but may well get through El Reg's filtering regime.

[Doctor Syntax]

The headline & first line of the article makes it clear that this is yet another attempt at this, even for Microsoft. Slow learners.

[Howard Sway]

But is it AI?

Are we talking about a simple blocklist, or will they have to train an AI to police the language?

Because if they want to train an AI, all they have to do is turn the microphone on whenever anyone is using their software, and they'll be able to capture the full range of profanity in every language and dialect in record time.

[Conrad Longmore]

Scunthorpe

Scunthorpe. I'll leave it at that.

[imanidiot]

Re: Scunthorpe

I'll add De Cocksdorp.

[Huw D]

Re: Scunthorpe

Fingringhoe

[Anonymous Coward]

Re: Scunthorpe

shitterton

[Anonymous Coward]

Could we please have a single checkbox in the MS Word options to turn off ALL of the annoying options.

Something along the lines of "What I type is exactly what I want, don't correct it or reformat it or bollocks it up in any other way. Just leave it the fuck alone."

[Ken Moorhouse]

RE: a single checkbox in the MS Word options to turn off ALL of the annoying options.

There is a separate item on the Accessories menu for that. It's called NotePad.

[veti]

Well, yes, it's called "autocorrect". You can absolutely turn it off entirely with a single checkbox.

I did that for a time, but eventually I realised it really was nice to have something correcting my basic tyops, and autocorrect does a pretty impressive job at that. So instead I just went through all the options and chose exactly which ones I wanted to keep.

[Ken Moorhouse]

Re: and chose exactly which ones I wanted to keep.

You forgot the one that corrected typos though.

Edit: Sorry, forgot my coat again--->

[Michael Wojcik]

At least for US English, the autocorrect list in Word is depressingly long, and you can only delete one entry at a time.

Fortunately, it turns out to be relatively straightforward to automate the process of removing entries using Office OLE Automation, which you can drive from the command line if you use a Powershell shell. I was able to delete them all with half an hour or so of research and experimentation (I don't use Powershell often), and it would have been easy enough to leave some had I wanted to.

I would have just left Autocorrect turned off, but I wanted it to convert "--" to an N-dash without screwing up hyphen-letter combinations as Word's "autoformat as I type" option to insert dashes does. (Tip for the Word developers: a single hyphen means a single hyphen.) Then I noticed that WinCompose gives me compose-hyphen-hyphen for that purpose, so I could have saved myself the trouble; but deleting all those autocorrect entries was so pleasing I didn't regret spending the time.

[Tron]

Feck, Arse, Girls, Drink.

Can you imagine proof reading an edition of 'Trainspotting' using this software?

Turn off Auto- everything, because it's all shite.

I suggested having user-definable levels of 'AI' in software in a recent design brief, and emphasised the need for users to be able to turn it off.

As evidence I would point to Google Search. Type in a complex search request and it will use its third rate chav AI to ignore most of your search terms and direct you to an article about a pop star, whose first name matches just one of your search terms. Not having a 'Turn 'AI' off' button in Google Search has made it almost as bad as Bing.

[CrackedNoggin]

Re: Feck, Arse, Girls, Drink.

The definition of AI is a little too broad to pin it down. However, most searches seem to return multiple hits all containing the most "a priori" likely meaning, based on all searches by all users - therefore your annoying result. One might hope that at least mutually similar results would be suppressed, so a wider range of interpretations would be returned. Or perhaps a couple of check boxes next to each result - "less like this" and "more like this".

Perhaps part of the problem is the service is driven by advertising revenue. If search were a service paid for by the users, we might see better development.

[imanidiot]

Re: Feck, Arse, Girls, Drink.

very much this. Google has become pointless for some complex searches because it just ignores all those carefully crafted search terms for it's on interpretation of what it thinks you might have meant (had you been a boozed up 4 year old suffering ADHD).

[veti]

Re: Feck, Arse, Girls, Drink.

"That would be an ecumenical matter."

[Anonymous Coward]

Absolutely necessary for Office 365

I absolutely understand the necessity for Office 365 to abolish swearing and worse.

Here comes my anecdote: Last week my son was preparing a lengthy text complete with table of contents and bibliography.

When trying to add a caption to a figure Word 365 on Mac decided to corrupt the document so that only 4 pages remained.

No way to recover the text within Word. Pages and LibreOffice still displayed the complete text but could not deal with the bibliography other than simply displaying. Saving allowed to continue with Word without the bibliography sources.

There is a Web version of Office 365 but the capabilities are even more limited than the Mac version of Word.

TOCs have been requested for iPad since 2015 at least. Excel on Windows supports barcode generation natively on Mac it does not.

So, yes, no swearing allowed is a good thing, and my son has learned several lessons.

[b0llchit]

Re: Absolutely necessary for Office 365

...and my son has learned several lessons

Ehm, several,... make regular backups and never use any MS Office products?

[imanidiot]

Re: Absolutely necessary for Office 365

I'll add to that: "A backup isn't a backup until you've tried restoring it and found it to indeed contain your data". Because even if you DO save your documents Word has a nasty habit of refusing to load something it created 5 seconds before.

[Ken Moorhouse]

Re: Here comes my anecdote

A solicitor client of mine who used Word habitually used Save rather than Save As, and ended up with a 95-page lease comprising asterisks.

WordPerfect, we need you! Table of Contents, Bibliographies were such a doddle.

[David 132]

Re: Here comes my anecdote

VMS had, as I recall, an auto-versioning file system, which would also have solved your solicitor's problem.

LEASE.DOC;1 LEASE.DOC;2

LEASE.DOC;3 LEASE.DOC;4

...and so on.

[Michael Wojcik]

Re: Here comes my anecdote

Anything I care about goes into a source code control system (I prefer Subversion, but pick your poison) with a remote repository, even non-text-format files, and gets committed frequently. Then I always have multiple backups from various points on its timeline.

I have conventional off-site backup mechanisms too, of course, but historical backups that are immediately accessible are invaluable.

Some years back an academic friend and I mooted a document-editing system (I won't call it a word processor, since I think that whole concept is fatally flawed) that would have used LaTeX for formatting, with a relatively novice-friendly front end like a stripped-down LyX, and a storage backend that would be git using a custom diff that operated at the text-and-formatting-markup-token level rather than text lines and weighted replacements and moves higher than additions and deletions (an easy change to the standard MED algorithm), and frequently pushed to a remote repo. Then we'd provide a timeline slider so it would be easy for users to see how the document changed over time, and controls for reverting particular changes, etc. The idea was to keep essentially all non-trivial revisions of a document with useful visualizations and controls. Never built it, but I think it would be a vast improvement over the primitive 1970s Xerox PARC model most people are still stuck with.

[WolfFan]

Oh, dear

Many, many, MANY years ago (damn, has it really been that long? Now I feel old…) I used Eudora for email. I was then on a medieval history mailing list. (Several of my friends and relatives, all of history nuts, were on the list as well.) One of my cousins also used Eudora, and he got a certain update before I did, and sent a note to the list filled with much more profanity than normal. You see, we were then discussing a certain Guilliame le Batard. And Eudora’s latest update included a feature called ‘Peppers’ which allegedly showed how ‘hot’ your email was and advised you to cool it down. Multiple uses of ‘Bastard’ could and did generate the max three peppers indicating a very naughty post. Those of us who used Eudora made a game of seeing how many peppers we could get with as little effort as possible. My cousin tried to get three peppers on every post.

I suspect that this MS feature may have similar results.

[Ken Moorhouse]

Re: ‘Bastard’

Just file it away.

Being a history buff, I'm sure you already knew...

https://www.wonkeedonkeetools.co.uk/files/how-did-bastard-files-get-their-name

[Anonymous Coward]

So that will mean most of the sysadmin emails after patch Tuesday are going to be somewhat 'different' then...

"Dear Users,

Another ******* mess with ****** Microsoft patches has caused a ****ton of ****** problems all over the ******* place. No ETA on when normal ******* service will return."

[David 132]

"Brussels is the capital of *******"

[ibmalone]

Seven languages you say?

Wake me when I can change the default dictionary for new documents.

[vogon00]

Oh, great - more editing.

Oh, FFS.

I can't see the point of this MS 'written content filtering'. It's the human author's responsibility to ensure the content they write is sanitised to the correct level for their audience - not someone/thing far,far away, with a different (most likely wrong) understanding of the authors situation and context.There are so may ways that AI proof reading can screw this up. How do you train an ML model to deal with nuanced multi-language documents anyway with any degree of accuracy?

It's got to be a human decision, by the author (and possibly the editor) of the whatever is written word is. There is already a scheme for doing this - simply tag things as 'NSFW' in the first paragraph. If people read past that warning, then they can't really take offence. It s a bit like getting a complaint about you walking naked past your own window; who's to blame - you for accidentally doing it, or them for looking? Smart people don;t take offence without real cause.

Yet another example of political in-correctness enforcement going too far, and being passed off as a useful innovation. I used to think Orwell's '1984' could never materialize.... now I'm not so sure.

[A. Coatsworth]

So many missed opportunities

"Threat, Targeted Harassment and Profanities Classifier" Pfffttt...

Why not calling it Targeting Incoming Threats System?

Or Profanities and Harassment Universal Controller and Keeper

Or Total Work Anti-Threat System

Or...

[Jimmy2Cows]

Try harder...

Controls Limiting Insulting Text On Respectable Institutional Systems

[David 132]

Re: Try harder...

Unfortunately that acronym is already being used by the Committee for the Liberation and Integration of Terrifying Organisms and their Rehabilitation Into Society.

[Jimmy2Cows]

Puritanical insanity and intolerance run amok

Perhaps time to break out the Dickensian insults.

Whoops. That'll probably trip the filters.

Why oh why does MS continue to pander to this ridiculous minority that wants to tell everyone else how to live their lives?

[Anonymous Coward]

@Jimmy2Cows - Re: Puritanical insanity and intolerance run amok

Maybe it's because nobody has the courage to stand up and fight ? Once you're being tagged by these new world commissars you no longer exist. Being wrong or right no longer matters, everyone will dissociate from you and will forget you ever existed. We experienced this kind of situation during the years under the Communist regime (it was one of their favorite threat agains those who did not comply) and I thought all this has gone into the history's dustbin never to be seen again. At least not in the civilized Western world. In those dark days I learned to keep my mouth shut and forefeit my freedom of expression. Suddenly, that old skill comes in handy these days.

[Anonymous Coward]

Newspeak is coming.

This is a model of thought control. U can see this gradually getting tweaked until it gets to the point where the computer reports you for thought crime.

[Daniel von Asmuth]

What took you so long?

There has clearly been a need for a filter in Word against profanities like 'Microshaft' or 'Windoze'. (Microschoft and Windhoos in Dutch).

[Ken Moorhouse]

Re: 'Microshaft' or 'Windoze'

Sometimes they do acknowledge their inadequacies.

Windows POS for example.