SPEC mulls benchmarks for ML processing performance

Benchmarking organization SPEC has formed a committee to oversee the development of vendor-agnostic benchmarks for machine-learning training and inference tasks. SPEC, the non-profit Standard Performance Evaluation Corporation, produces a range of benchmarks that are widely used to evaluate the performance of computer systems …

[Paratrooping Parrot]

Erm...

“IDC expects enterprises to spend nearly $342 billion on AI in 2021, and it's essential that these companies understand what that money will buy,” Kang said in a statement.

I think they need to work it out a tad faster as it's 2022 already. :)

[diodesign]

IDC figures

I think the point is that it's too early to know exactly how much was spent in 2021, so IDC is guesstimating right now.

C.

[Anonymous Coward]

Too bad

They're only measuring speed and not accuracy. Going 10% faster from Garbage In to Garbage Out doesn't seem to me to be a useful benchmark.