Reply to post: Re: "No one really understands why machine-learning code is so brittle"

Nice 'AI solution' you've bought yourself there. Not deploying it direct to users, right? Here's why maybe you shouldn't

Bronek Kozicki

Re: "No one really understands why machine-learning code is so brittle"

Another good point. A well-presented ML will typically return a prediction, which is interpreted as probability value. If the value is exactly 0 or 1 then either the model is broken or rounding error got in the way. Typically, for a great quality model and where the match is perfect, the value might be up to 0.97, perhaps 0.98. It is up to humans to actually read this value and think "hmm, this could be something else with 3% probability".

But then, humans just love survivor bias : if the ML was right more than 10 times in a row we stop paying attention and replace thinking with generalisation. It is good thing that some researchers are actually pushing the probability value closer to 1, but we also need to start paying attention. Because it will never be 1 and yet it will be frequently interpreted as such.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Biting the hand that feeds IT © 1998–2022