Release
PyTorch 2.14.0 released with torch.switch, NVGEMM in Inductor, and a preview NCCL backend rewrite
PyTorch 2.14.0 was published on GitHub on September 2, 2026. The release notes highlight NVGEMM, which brings CuTeDSL-generated CUTLASS kernels to Inductor, and torch.switch, which generalizes torch.cond to multi-way branching. Other highlights include declarative dynamic shapes via @dynamic_spec, experimental torch.compile support for complex-valued tensors, a preview of a rewritten NCCL backend ported from torchcomms, and native linear algebra on Apple Silicon. The notes also say Inductor now targets Rubin (sm_107). USASI has not tested this release.1
Related catalog entries
Sources
Share or cite this page
- X (opens X)
- Bluesky (opens Bluesky)
- LinkedIn (opens LinkedIn)
- Reddit (opens Reddit)
- Hacker News (opens Hacker News)
- Email (opens your email app)
- RSS updates
Cite this page
APA style
USASI. (2026, October 13). PyTorch 2.14.0 released with torch.switch, NVGEMM in Inductor, and a preview NCCL backend rewrite. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/pytorch-2-14-0-released/
BibTeX
@misc{usasi_news_pytorch_2_14_0_released,
author = {{USASI}},
title = {PyTorch 2.14.0 released with torch.switch, NVGEMM in Inductor, and a preview NCCL backend rewrite},
year = {2026},
month = oct,
howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/pytorch-2-14-0-released/}},
note = {United States of America Superintelligence. Last updated 2026-10-13}
}The date is when this page was last updated. Add the date you read it if your style needs one.