Re: How much memory are they planning?
there is likely to be a cost benefit 'maximum point' on L1 and maybe L2 and L3 cache. going 1000 times the L1 cache size we typically use NOW might get you bragging rights, but I question how much speedup it gets you as compared to now, or 10x, or 100x the size.
We're almost "there" with respect to storage in (essentially) non-volatile RAM with SSDs. That makes an observable difference in speed. But if you spend only 1% of the processing time waiting for RAM bus cycles because the cache is 'empty', how much of a difference would it make to eliminate that 1% ? Observably by an end-user, not a whole lot. The price tag, however, WOULD make a difference.