Log in Sign up

# What do you mean your exaflop is better than mine?

A multi-exaflop supercomputer the size of your mini-fridge? Sure, but read the fine print and you may discover those performance figures have been a bit … stretched. As more chipmakers bake support for 8-bit floating point (FP8) math into next-gen silicon, we can expect an era of increasingly wild AI performance claims that …

## COMMENTS

1. My personal fave standard is SATA 3 transferring files at "6 Gb/s." Has anyone seen anything above 1Gb/s transfers? How about 512Mb/s?

1. Most modern hard drives can do around 2Gb/s (250MB/s) and a SATA 3 SSD can do 5Gb/s (625MB/s) in sequential reads.

2. My personal fave standard is SATA 3 transferring files at "6 Gb/s." Has anyone seen anything above 1Gb/s transfers? How about 512Mb/s?

Yes, pretty much every SATA SSD I've used can hit around the 600-650MiB/sec mark.

650MiByte/sec * 8 = 5200MiBit/sec.

5200 * 1024 = 5324800 bit/sec / 1000 / 1000 = ~5.3Gbit/sec

Given protocol overhead needs factoring into that, seems pretty close to me.

2. #### Pentium of Borg

Mathematics is futile - you will be approximated.

.

.

.

Anyone still remember the FDIV bug?

3. #### What's the ElReg standard?

I assume the answer is 'nobody's done it' but, like all other benchmarks, it would be helpful if an FP64 installation was benchmarked with FP8.

The whole thing seems like marketing set the goal of 'exa' and the engineers figured out what benchmark would get them there.

Let's just be glad they didn't settle on FP4 (or 2 or 1).

Personally I'm going to go on with my life. This doesn't even rate popcorn.

1. #### Re: What's the ElReg standard?

I'd have thought FP8 (256 "numbers") could be done in look up tables, no need for actual processing logic of any complexity. As the bit number goes up I think either the silicon area goes up exponentially or the speed down so maybe 8 bits is a sweet spot for lots of mini-ALUs on the chip.

2. #### Re: What's the ElReg standard?

I think FP1 is the way forward. Followed by FP2, FP3, Q1, Q2, Q3, then the race (R1?) On Sunday.

4. So then... how many teraflops was a Commodore 64?

1. #### how many teraflops was a Commodore 64?

Not many.

Neither was my CPC.

I once wrote my own floating point routines in Z80 assembler implementing non-optimal algorithms, and achieved a doubling of speed over a lower precision implementation used by a pascal compiler.

I didn't need division :)

1. #### Re: how many teraflops was a Commodore 64?

"I didn't need division".

If you can loop and subtract you have division too.

In machine code I once had to do that instead of division needing to make it much faster, that was around 1970.

And yes I know I behave like a besserwisser now.

5. #### Amusing

I find this kind of thing very amusing. No one knows exactly how their AI ML rigs produce the answers they do. Everyone knows that moving down to FP8 is adding a ton of noise to their calculations. No one can tell if that's a problem or not. But they do know it's running faster, and that's probably a bigger "success" metric than "correct answers" are (cos no one is expecting AI/ML to output perfection).

Results are that the chip makers can sell more chips, the researchers can point to their progress in speeding these things up or making them bigger...

As for whether they work properly or not? Well that's likely taken a hit...

6. #### How many values in FP8?

Are they coercing to integers, or is it actually 'true' floating point with sign bit, mantissa and exponent?

How many bits of mantissa and exponent?

Does the implementation include subnormals, or do they all get coerced to zero?

-0, +/-Inf and NaN don't count as numbers, so there's only 252 unique values. Fewer if you exclude subnormals.

IEE754 doesn't define FP8 yet, so it's impossible to compare any 'FP8' implementations.

Graphics cards have of course been consuming and outputting 8-bit values since the very beginning.

1. #### Re: How many values in FP8?

The usual format seems to be a (sign, exponent, mantissa) format of (1, 5, 2) bits.

1. #### Re: How many values in FP8?

that or 1-4-3, depending on if you're nvidia or not, but I can't remember which is which

1. #### Re: How many values in FP8?

Either way there's a trap here, using such a low precision with a wide dynamic range means that when adding multiple numbers, small ones may not contribute to the total because they are individually too insignificant. If there are many such small numbers then you'll get a very wrong answer.

## POST COMMENT House rules

Not a member of The Register? Create a new account here.

• ### Add an icon

Anonymous cowards cannot choose their icon

### Other stories you might like

Biting the hand that feeds IT © 1998–2022