Homeglossary

NVLink

NVLink is a high-speed NVIDIA interconnect that lets compatible GPUs and processors exchange data directly with high bandwidth and low latency. It is used primarily in AI, high-performance computing, and data-center systems where several GPUs must work as one coordinated compute resource. Its value depends on the specific GPU generation, system design, software, and workload, not simply on having multiple GPUs installed.

What Is NVLink?

NVLink is a high-speed NVIDIA interconnect that lets compatible GPUs and processors exchange data directly with high bandwidth and low latency. It is used mainly in AI, high-performance computing, and data-center systems where multiple GPUs work as a coordinated resource.

Instead of sending GPU traffic through a computer's standard expansion bus, NVLink provides dedicated connections between supported devices. It can reduce time spent moving data between GPUs. NVLink is proprietary and works only with supported NVIDIA hardware and platform designs.

NVLink does not automatically combine all GPU memory into one universal pool. Each GPU retains its own physical memory, although software can access another GPU's memory in supported situations. Efficient use depends on the framework, drivers, communication libraries, and workload design.

Why GPU-to-GPU Communication Matters

Adding GPUs does not always make a job proportionally faster because GPUs must exchange instructions, intermediate results, and data.

In AI training, each GPU may process part of a model or batch, then synchronize updates. In scientific computing, simulation partitions exchange boundary data. Slow transfers can leave GPUs waiting.

Bandwidth is the amount of data a connection carries over time, while latency is the delay before data begins to arrive. Peer-to-peer access lets one GPU read or write another GPU's memory without routing traffic through a CPU and system memory. Collective communication coordinates exchanges among many GPUs, such as combining training updates.

How NVLink Works

NVLink is a hardware-and-software path that an application must support, not a switch users simply turn on.

  1. Compatible GPUs, CPUs, or accelerators include NVLink capability in their hardware design.
  2. Physical links connect supported devices directly or through switching hardware in larger systems.
  3. The operating system, NVIDIA driver, and CUDA stack detect the topology and enable peer communication.
  4. Applications and libraries move tensors, simulation data, rendering assets, or other information across available paths.
  5. Several links can work together to increase communication capacity between devices where supported.
  6. The application schedules transfers to overlap with useful GPU work when possible.

That final step matters. NVLink provides the route, but CUDA-aware communication libraries determine when and how data moves. Poor scheduling, uneven workloads, or congestion can still limit performance.

Key Components: NVLink, NVSwitch, and Software

A direct NVLink connection is usually a point-to-point path between compatible devices. Larger systems need a way to connect many GPUs without relying on limited direct pairings.

NVSwitch is switching technology used in certain NVIDIA platforms to create a larger scale-up fabric. It helps many GPUs communicate within one compute domain. NVLink is the connection technology, while NVSwitch extends connectivity across more devices.

Other components include the physical interconnect, high-bandwidth GPU memory such as HBM, server board layout, GPU topology, drivers, CUDA peer access, and collective communication software such as NCCL. The slowest or least direct path can shape performance. Teams building AI products can also benefit from understanding how infrastructure choices support AI app builders and their applications.

NVLink vs PCIe vs NVSwitch vs InfiniBand

These technologies solve related but different communication problems. They are not interchangeable.

TechnologyTypical scopeMain strengthKey limitation
NVLinkBetween supported processors in a server or scale-up systemFast, direct communication for tightly coupled GPU workloadsRequires compatible NVIDIA hardware and platform support
PCIeGeneral-purpose device connection inside a computerBroad compatibility for GPUs, storage, networking, and other devicesUsually less specialized for intensive GPU-to-GPU traffic
NVSwitchMany GPUs in a larger scale-up fabricExtends NVLink-style connectivity across a dense GPU systemAvailable only in specific integrated platforms
InfiniBandBetween servers in a scale-out clusterHigh-performance networking across separate machinesIt does not replace the need for fast local GPU communication

NVLink is generally faster than PCIe for supported GPU-to-GPU communication, but results vary by application. It is not simply faster than InfiniBand because they operate at different layers. NVLink and NVSwitch scale up within a system, while InfiniBand commonly scales out across servers. Large AI clusters may use both.

Is NVLink Just SLI, and Is It Obsolete?

NVLink is not just SLI. SLI was primarily a consumer graphics approach for combining GPUs to render games. NVLink is an interconnect used in professional visualization, AI, research, and data centers.

Consumer multi-GPU support has narrowed on newer generations, so many desktop users no longer encounter NVLink. That does not make it obsolete. It remains important in supported professional and data-center platforms, where GPU data movement is central. PCIe remains common for general connectivity, NVSwitch expands dense GPU systems, and InfiniBand connects separate servers.

Where NVLink Is Used

NVLink is most useful when GPUs exchange large amounts of data frequently, rather than running separate jobs side by side.

  • AI training, where GPUs synchronize gradients and exchange model activations.
  • Large-model inference, where a model is split across GPUs and passes intermediate results between them.
  • Scientific simulation, where fluid, weather, molecular, or physics models exchange boundary data.
  • Data analytics, where distributed GPU operations combine partial results.
  • Digital twins and engineering analysis, where GPUs process connected parts of a virtual system.
  • High-end rendering, where GPUs may share scene information, textures, or workloads.
  • Multi-GPU software development, where teams assessing app design and development may need to understand infrastructure behind compute-heavy AI features.

Benefits of NVLink

NVLink can improve performance for communication-heavy workloads.

  • Higher GPU-to-GPU throughput than conventional general-purpose paths in supported configurations.
  • Lower communication overhead for workloads that repeatedly exchange large data sets.
  • More effective multi-GPU scaling when software uses peer communication and collectives.
  • Direct peer memory access in supported cases, reducing unnecessary CPU movement.
  • Support for dense GPU systems that act like one coordinated compute resource.

Practical Limits and Common Pitfalls

NVLink is not a universal performance upgrade. Planning around the actual workload helps prevent expensive mistakes.

  • Compatibility is strict. Matching NVIDIA GPUs may still lack required NVLink support, connectors, server design, or software configuration.
  • NVLink-capable platforms can cost more and may require substantial power, cooling, and rack planning.
  • Topologies differ. Some GPU pairs have more direct paths than others, creating uneven performance.
  • Applications may not use peer access efficiently, even when hardware supports it.
  • Memory is not automatically merged. Capacity and access behavior depend on the application and framework.
  • NVLink cannot fix workloads limited by computation, storage, CPU preparation, network I/O, or poor parallelization.
  • Theoretical link bandwidth is not end-to-end application throughput because of software overhead and synchronization delays.

How to Decide Whether NVLink Is Worth It

The right decision comes from evidence, not GPU count or marketing specifications alone.

  1. Identify whether the workload spends meaningful time waiting for GPU-to-GPU transfers or synchronization.
  2. Verify exact GPU, server, firmware, driver, and operating-system compatibility.
  3. Inspect the topology to see which GPUs have direct paths and where switching hardware is involved.
  4. Benchmark the actual model, simulation, renderer, or analytics pipeline with realistic batch sizes and data flow.
  5. Compare PCIe-only and NVLink or NVSwitch options using job time, throughput, cost, power, and operational needs.
  6. Separate tightly coupled work from independent work. Model training may benefit substantially, while separate batch-inference requests may gain little.

The Direction of NVLink and Scale-Up AI Systems

NVLink has developed from direct links between a small number of GPUs toward larger scale-up fabrics for tightly integrated AI systems. Accelerator performance depends on both GPU speed and efficient information exchange.

NVIDIA has described NVLink Fusion as an architectural direction for connecting NVIDIA infrastructure with compatible custom processors. Availability and capabilities vary by product generation and platform, so buyers should evaluate documented configurations rather than assume every announced feature applies everywhere. For current details, consult NVIDIA's NVLink documentation. In multi-GPU computing, interconnect design remains as important as processor speed.

Start Building
on Emergent today
Start Building