Reply to post: Re: Accuracy != Robustness

Fujitsu sidesteps data scientists with a move toward tuned machine learning

Anonymous Coward
Anonymous Coward

Re: Accuracy != Robustness

Furthermore: "Where the analysis takes more than 12 hours it’s usually applied to a sub-set of the data and the result is less accurate."

Is patent nonsense. Firstly, if you are doing analysis on all the data then you have all the possible results. But let's assume you mean all the data available now. Even so there is a very well understood technique called sampling that is at the heart of statistics. The accuracy* improvement you get from going from a very large dataset to a very very large dataset is usually very small.

Finally there are a whole range of reasons why an analysis can take more than 12 hours. Run it on your ZX81 cluster and you would be delighted to get any answer within 12 hours.

*see above comment for more on accuracy.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Biting the hand that feeds IT © 1998–2021