back to article If you want to connect GPUs direct to SSDs for a speed boost, this could be it

Nvidia, IBM, and university collaborators have a developed an architecture they say will provide fast fine-grain access to large amounts of data storage for GPU-accelerated applications, such as analytics and machine-learning training. Dubbed Big accelerator Memory, aka BaM, this is an interesting attempt to reduce the …

  1. Dwarf Silver badge

    Whats old is new

    So they have reinvented a form of DMA (Direct Memory Access), just with a different endpoint attached to it ?

    Wasn't this problem solved in the 1970's ?

    1. diodesign (Written by Reg staff) Silver badge

      Just check out the paper

      It's just an interesting way to get threads on GPU cores to talk direct to NVMe SSDs to get the data they need in a fine-grained, software-cached manner that specifically suits the access patterns of GPU-bound applications.

      Yeah it involves DMA and all that. It's not claiming to have reinvented or come up with DMA; it's an application of it specific to GPU workloads.

      C.

      1. bazza Silver badge

        Re: Just check out the paper

        Software cached just sounds like what IBM did with the Cell processor, where the data and code in the SPE's limited RAM was not controlled by a hardware cache mechanism second guessing what the software would ask for next, but by the orchestrating software putting data and code there for itself.

        From the point of view of developers like me, that was fantastic. However the problem was that it was so far off the beaten track for a lot of developers it bombed as a concept and IBM dropped it, which was a real pity. Neat as this latest idea is, if it involves custom hardware on IBM's part I'd not be counting on them sustaining it as a dependable product line.

        But it's in interesting idea. People have been looking for GPUs that can do more. Trouble is that, taken too far, you end up with something like an AMD APU....

    2. Boris the Cockroach Silver badge

      Re: Whats old is new

      Yeah, Z80s had a DMA mode where a system chip (usually the GFX chip) could set the CPU to DMA mode so that it could access main memory without the CPU cycles getting in the way

      I think zilog had a FDD/HDD controller that used that mode too with a similer method to that in the figure of sending the controller the addresses to use along with block size, and the controller would use a DMA mode when the data had arrived from the disk and write it to memory.

    3. A Non e-mouse Silver badge
      Meh

      Re: Whats old is new

      I guess the reason this is really taking off is that the storage is no longer the bottleneck. In the past you needed something like a CPU to moderate access to storage to ensure no one device or process hogged storage. Now storage is no longer the bottleneck and everything can talk to it direct.

  2. This post has been deleted by a moderator

  3. Steve Medway

    Looks a hell of a lot like how the Radeon Pro SSG with it's onboard 2tb ssd works.

    So it looks to me nvidia are almost six years behind AMD on this idea...

    1. Dave 126 Silver badge

      https://www.pcgamer.com/uk/amd-radeon-pro-ssg-pairs-vega-with-2tb-of-memory/

      A large part of the AMD implementation was having faster-than-PCIe hardware interconnects twixt the SSDs and the GPU chip. The SSDs would be seen by the GPU as a slower tier of memory in addition to its RAM. The nVidia solution involves off the shelf hardware with custom software and drivers.

      Are both ideas trying to make things faster? Well yeah, thats usually the game!

  4. UK DM

    Just a day after Direct Storage goes GA

    The future if NVMe to GPU data transfer looks rosy, be it for computation or gamers.

    https://devblogs.microsoft.com/directx/directstorage-api-available-on-pc/

    This promises to gamers a future for loading textures and other graphics artifacts from NVMe to GPU with lower CPU overhead.

    But still needs GPU vendors to provide support at their end both in revised hardware and drivers to achieve the objectives.

    So this ElReg article appears to mimic for Linux what Microsoft have had in beta over past 18 months.

    Here is to an open source and spec future. Hip hip..

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like

Biting the hand that feeds IT © 1998–2022