• Competitor rules

    Please remember that any mention of competitors, hinting at competitors or offering to provide details of competitors will result in an account suspension. The full rules can be found under the 'Terms and Rules' link in the bottom right corner of your screen. Just don't mention competitors in any way, shape or form and you'll be OK.

What Is NVLink? And How Will It Make the World’s Fastest Computers Possible?

Caporegime
Joined
24 Sep 2008
Posts
38,284
Location
Essex innit!
The numbers are big and so is the news. The U.S. Department of Energy today unveiled plans to build two GPU-powered supercomputers. Each will deliver at least 100 petaflops of compute performance.

And one – the Summit system at Oak Ridge National Laboratory, designed for open science – is expected to be 150 petaflops. That’s more than three times the peak speed of today’s fastest supercomputer.


These big machines will have big goals. Summit and Sierra, at the Lawrence Livermore National Laboratory, promise breakthroughs in energy efficiency, climate modeling, natural disaster prediction, safe nuclear material storage, and more. (For more, see our overview of the project.)

NVLINK: Big New Posibilities

The story behind the headlines: a key new technology we’re developing, called NVLink, will be the backbone of these supercomputers. NVLink will connect the machines’ processors – CPUs and GPUs – so they can exchange data 5 to 12 times faster.

It’s no secret that GPU accelerators now power many of the world’s fastest supercomputers. With thousands of computing cores in a single GPU chip, compared to tens of cores in a CPU, a GPU can process massive amounts of scientific data in a hurry. Roughly 10 times faster than a CPU.

While GPU performance has been increasing fast, the pipe that feeds data to GPUs has not kept up. Supercomputers today rely on a technology called PCI Express to connect GPUs to CPUs. That’s a technology you can find in the desktop and notebook computers you use right now. It’s fast, but not fast enough.

So, What Is NVLink?

NVLink, the world’s first high-speed GPU interconnect, offers a faster alternative. NVLink will let data move between GPUs and CPUs five to 12 times faster than they can today. Imagine what would happen to highway congestion in Los Angeles if the roads expanded from 4 lanes to 20.

That’s fast enough to let the GPU suck data from the CPU as quick as a CPU can get it from its own memory (see “How NVLink Will Enable Faster, Easier Multi-GPU Computing”).

There are other benefits, too. NVLink lets CPUs and GPUs connect in new ways to enable more flexibility in server design. NVLink is also much more energy efficient than PCI Express.



This flexibility – and efficiency – will play a key role in Summit and Sierra. NVIDIA GPUs and IBM POWER CPUs, connected with the NVLink interconnect technology, will power both machines.

Summit and Sierra, in turn, are a step towards much larger, exascale computers. And NVLink is one of the technologies U.S. Department of Energy believes will get us there. Such a machine could crunch 1 quintillion floating-point operations per second, or a one followed by 18 zeros.

That’s a big number. And that means while today’s news is big, the biggest news is yet to come.

- See more at: http://blogs.nvidia.com/blog/2014/11/14/what-is-nvlink/#sthash.Th9TiFL5.dpuf


A very interesting read and doing away with the need for moving data between the PCI-E. The GPU can move data between the CPU and GPU between 5 - 12 times faster.

http://devblogs.nvidia.com/parallelforall/nvlink-pascal-stacked-memory-feeding-appetite-big-data/

So looks like Pascal will be the first to get this tech and whilst that may be some time away, I am very much looking forward to it (and I bet Kaapstad is as well). PCI-E is already proving to be a bottleneck and that will only get worse as time goes on and we get faster GPUs.
 
Unless Intel gets on board with this or Nvidia starts making chipsets again, I suspect this will be limited to the commercial market for a while. BTW,what is missing from the quotes is that this was probably co-developed with IBM as the POWER platform has support for it.

Edit!!

Some news about it three months ago:
https://www.google.co.uk/url?sa=t&s...LBdDQY30ABhCV8Gvw&sig2=wlZ3Q6mswYjSEkUPLE1oxA

Emm,the link in the OP is three months old. Come on Gregster you need to keep up with the pace LOL! :p
 
Last edited:
Unless Intel gets on board with this or Nvidia starts making chipsets again, I suspect this will be limited to the commercial market for a while. BTW,what is missing from the quotes is that this was probably co-developed with IBM as the POWER platform has support for it.

Edit!!

Some news about it three months ago:
https://www.google.co.uk/url?sa=t&s...LBdDQY30ABhCV8Gvw&sig2=wlZ3Q6mswYjSEkUPLE1oxA

Emm,the link in the OP is three months old. Come on Gregster you need to keep up with the pace LOL! :p

Yer, I know it's old but someone asked what nvlink was, so thought I would do a thread. And yep, they are co-developing this with IBM for the super computers.
 
Surely this would require Intel/AMD to integrate it into their CPUs?

I can see a new version of SLI, whereby there is such inter-gpu bandwidth that you don't need to duplicate the contents of each GPUs memory and there can be one large memory pool...
 
Thought this was a fix for the 970's missing .5gb-NvidiaVramLink.:p


Don't know how it will play out considering it'll (probably)require a dedicated NVL proprietary chipset, if your an elitist, it'll probably be right up your street.:)
 
Back
Top Bottom