From what i understood, the Cerebras chip basically wants to be as close to a brain as possible, but could somebody clarify whether a transistor is equivalent to a neuron, a core is equivalent to a neuron or whether it's not that simple?
IBM, Intel tease 2020's specialist chips: Power9 'bandwidth beast' – and Spring Crest Nervana neural-net processor
At the Hot Chips symposium in Silicon Valley on Monday, IBM and Intel each revealed a few more details about some upcoming processors of theirs. From Big Blue, an addition to the Power9 family, dubbed a "bandwidth beast," and from Chipzilla, a Nervana neural-network processor code-named Spring Crest. I got the Power Let’s …
COMMENTS
-
-
-
Wednesday 21st August 2019 19:01 GMT Jaybus
Cerbras, like Nervana, really functions very differently from a biological neural net. These are clusters of vector processors optimized for performing many matrix operations in parallel. The real trick to these is the intra-chip networking with all compute clusters interconnected by a crossbar switch and extremely high intra-chip bandwidth.
It isn't really designed to be barin-like. There are, however, neuromorphic chips that are designed to model/approximate a neural network, such as TrueNorth, Loihi, and whatever is used in the SpiNNaker. These are likely the future of the actual use of already trained ANNs (inference) in devices, since they will use far less power.
-
-
-
Tuesday 20th August 2019 11:49 GMT Anonymous Coward
Re: Same problem as Intel
For POWER? IBM are hitting their roadmaps (*cough* SPARC and Itanium *cough*) and they have the challenge of moving from GF to Samsung given GF's dropping of new process nodes.
Given that IBM already have good CPU scaling stories, increasing IO and memory bandwidth does make for a significant performance increase when combined with custom accelerators and given the relative market share, the argument for avoiding high risk designs on unproven process nodes with theit customer base (i.e. low volume, cyclical purchases) is valid.
And it's entirely likely POWER10 will arrive before Intel have a competitive process node (i.e. 7nm given their issues with 10nm)
-
-
-
Tuesday 20th August 2019 16:07 GMT John Savard
Re: Too bad no one uses Power9
What's really too bad is that not just anyone can make x86 chips. So Oracle has to make do with SPARC, IBM has to make do with PowerPC, and so on and so forth, and there isn't a fully competitive microprocessor market, with only AMD permitted to compete with Intel.
Is the world going to switch from Microsoft Windows running on x86 to Linux running on RISC-V? Not any time soon, I wouldn't think.
-
Tuesday 20th August 2019 16:45 GMT returnofthemus
Is the world going to switch from Microsoft Windows...
Depending on the world that you live in, I'd say that it already has, the cloud was built on Linux and Linux is ISA neutral, you no longer have to choose the architecture for your applications, you can run your applications on the best architecture
-
Tuesday 20th August 2019 22:09 GMT Paul A. Clayton
Re: Is the world going to switch from Microsoft Windows...
Linux is not ISA-neutral. E.g., it effectively requires caches to support virtual address aliasing. It is also strongly oriented toward a ring-based permission system and linking translation and permission. The application environment for Linux is certainly not oriented toward use of capabilities (i.e., passing permissions in a fat pointer).
-
Thursday 22nd August 2019 11:24 GMT returnofthemus
Linux is not ISA-neutral...
Hmm!
Let's examine this one.
Introduced on the Mainframe in 1999 with a growing MIP count, ported to POWER in 2000, with little endian support added via the OpenPOWER foundation in 2014. Then you've got Fedora SPARC for....well you've probably guessed it already?
Nothwithstanding all those ARM-based so-called smart devices.
So you've got Linux on the Mainframe, Linux on POWER Systems, Linux on SPARC and Linux on ARM, as well x86 both Intel and AMD.
I'm not sure how you'd describe it, but I think much of the world would describe it as ISA-neutral
PS Microsoft's Cloud was initially called 'Windows Azure', why do you think they changed the name to 'Microsoft Azure?
No prizes for the right answer ;-)
-
-
Wednesday 21st August 2019 14:08 GMT Anonymous Coward
Re: Is the world going to switch from Microsoft Windows...
"the cloud was built on Linux and Linux is ISA neutral, you no longer have to choose the architecture for your applications"
Yes - you no longer choose the architecture, you use the architecture provided by the cloud providers. It will hasten the demise of some of the minor players, but the decisions will be economic rather than technical.
-
-
Tuesday 20th August 2019 18:03 GMT Anonymous Coward
Re: Too bad no one uses Power9
The POWER architecture is open source via OpenPOWER and SPARC is open source via OpenSPARC.
While they are used for certain applications, the high end chips are very expensive to develop and produce - these aren't 10-20mm cores like ARM.
The reality is that x86 is good enough for most high end applications and ARM is good enough for power conscious applications/general purpose CPU's for managing dedicated processors that the requirement for other architectures makes them uneconomic. I suspect China will prove me wrong with MIPS or a similar architecture, but designing/enhancing/producing a CPU to compete with ARM/x86 is a multi-billion dollar process.
That said, I think IBM have got a few more years to go with POWER (10th generation with 2/3 revisions and then a likely 11th generation to get us towards 2030 unless quantum computing surpasses mainstream CPU's - even then it's likely to be too soon for mainframes and their customer base to take that leap)
-
Wednesday 21st August 2019 21:20 GMT Michael Wojcik
Re: Too bad no one uses Power9
unless quantum computing surpasses mainstream CPU's - even then it's likely to be too soon for mainframes and their customer base to take that leap
I can't think of an algorithm in BQP that's particularly useful for the vast majority of mainframe workloads. Someone might naively think that typical mainframe workloads involve "a lot of searching" and so Grover's is applicable; but the kinds of complex-key searches that are common in those applications create a huge keyspace (due to combinatorial explosion), so even if you could get a QC implementation with sufficient qubits it would be hugely inefficient to perform those searches directly using QC.
If we ever have economically-feasible QC for business computing (and that's a big if), Grover's might well be useful for microarchitectural and kernel-level lookups and other cases where you might make use of a (probable) quadratic speedup in evaluating a function. But it's likely to remain practical only where the domain is relatively small, except for specialized applications against a small set of high-value data.
-
-
-
-
-
Tuesday 20th August 2019 17:54 GMT Anonymous Coward
Re: What's Old is New Again
OMI is about buffering to allow longer paths between the CPU and RAM and allowing more RAM chips per memory bus (i.e. greater electrical load). Rambus was about decreasing the memory bus width in exchange for very high transfer speeds.
The ideas behind OMI are not new (it has been used in many forms over the years to provide high memory capacities) but it has always had the significant drawbacks of being expensive and increasing latency. Given the latest POWER chips focus on improved IO/memory bandwidth, the drawbacks are outweighed by the benefit of cost effectively increasing memory bus width for large capacity servers.
OMI's advantage over some of the previous methods of increasing memory/memory bus width appears t be around the effect on latency, although I suspect the latency hit maybe compared to other POWER memory options such as Chipkill that already have additional overhead.
-