← Back to feed / //datascience

PyTorch 2.14: NVGEMM backend, nccl2 and fault tolerance as a first-class c10d concept

Data Science

Sep 10, 2026

3 reads 0 shares

PyTorch 2.14 lands with 2,995 commits from 487 contributors: the CuTeDSL-based NVGEMM backend, an in-tree nccl2 distributed backend with one-sided RMA windows, in-place process-group reconfiguration, @dynamic_spec and torch.switch in torch.compile, and a rewritten MPS linear algebra stack. Python 3.15 is eager-only.