Tiny Corp launches Nvidia-powered AI computer because 'it just works'

After a weeks-long struggle to get its AMD RX 7900XTX-based TinyBox working on open source firmware, Tiny Corp says it will be launching an Nvidia RTX 4090 version for users who want something that "just works." The AI startup founded by security hacker George Hotz originally selected AMD's flagship gaming GPU for its TinyBox …

[mark l 2]

Did Tinycorp really expect AMD to open source their firmware just because some AI startup had issues with the speed they fix bugs with their GPUs?

[Anonymous Coward]

Any news is a kind of advertising.

[Anonymous Coward]

"... he confirmed on March 23 that CEO Lisa Su herself had turned Hotz down"

Over lunch? Or was it just a personally signed "Dear George .... Stay in Touch, Yours, Lisa" letter?

[FeepingCreature]

As somebody who's having crashes with exactly that specific pile of shit in exactly that card regularly:

Expect? No. Hope? Yes.

At this point AMD kinda have to take drastic step to regain-- wait, that's incorrect. *Gain* customer confidence. The only thing I have confidence in them is fumbling otherwise-good technology with terminal lack of polish.

Sidenote: anyone know where this mysterious repo is? edit: Aah, https://gitlab.freedesktop.org/tomstdenis/umr cool stuff.

Oh, and: George Hotz is completely right about AMD.

[Anonymous Coward]

Question

https://tinygrad.org/

738 FP16 TFLOPS (red) / 991 FP16 TFLOPS (green)

144 GB GPU RAM

5.76 TB/s (red) / 6.05 TB/s (green) RAM bandwidth

28.7 GB/s disk read bandwidth (benchmarked)

AMD EPYC CPU, 32 cores

2x 1500W (two 120V outlets, can power limit for less)

Runs 70B FP16 LLaMA-2 out of the box using tinygrad

$15,000 (red) / $25,000 (green)

Elsewhere I see NVIDIA GeForce RTX 4090 listed for ~$2K, and AMD Radeon™ RX 7900 XTX listed for ~$1K.

I don't see how many of each get installed in Tiny's red and green versions.

Is it just one, or more?

[captain veg]

Re: Question

> I don't see how many of each get installed in Tiny's red and green versions.

> Is it just one, or more?

From the article (second paragraph): "The AI startup founded by security hacker George Hotz originally selected AMD's flagship gaming GPU for its TinyBox, a computer equipped with six graphics" cards "

-A.

[AdmFubar]

nothing tiny about the price...

[EvaQ]

Unless it's indeed an AI beast, and solves all your business problems.

15 kUSD is not that much for a business that needs it.

[Lon24]

The Second Coming?

Wow, I thought the old Tiny Computers had returned. Hands up those who had one.

https://en.wikipedia.org/wiki/Tiny_Computers