Reply to post: Re: "99.99 per cent of the sensor stream data produced is discarded"

BIG DATA wizards: LEARN from CERN, not the F500

Lost_Signal

Re: "99.99 per cent of the sensor stream data produced is discarded"

Good catch!

Looks like some 9's got dropped in the shuffle (as well as looking around many secondary sources had it wrong).

Lets try this again shall we?

L1 filtering 40Mhz to ~60-65Ghz (so ~.015% data retained).

L2 filtering 65Khz to 6Khz so (10% of data retained)

L3 filtering 5-6Khz to 500-600hz so (10% of data retained). So 99.99995 % of data is filtered (well before further passes are made at the data). (This math check out?)

As much as I love arguing about percents, the point is a lot of companies are hoarding the inverse (99.99% rather than 0.01, or 0.000001%), something they can "afford" to do at small scale when they don't try to do anything useful with the data, but will not scale as volumes grow.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Biting the hand that feeds IT © 1998–2022