Blog

The field of large language models is shifting toward lower-precision computation. This shift necessitates a…

Summary  PyTorch Distributed Checkpointing (DCP) is making investments into addressing the interoperability blockers to ensure…

Blog cross-posted on the Linux Foundation blog. As we approach the midpoint of 2025, the…

The tools we use to build AI are evolving fast, with PyTorch at the heart…

On May 17, the PyTorch Meetup was successfully held in Hangzhou, drawing nearly 60 developers…

PyTorch/XLA is a Python package that uses the XLA deep learning compiler to enable PyTorch…

Mixture-of-Experts (MoE) is a popular model architecture for large language models (LLMs). Although it reduces…

Key takeaways: PyTorch today powers the generative AI world with major AI players like Meta,…

At the end of March, the PyTorch Korea User Group hosted a special meetup that…

Overview In PyTorch 2.5.0 release, we introduced FlexAttention torch.nn.attention.flex_attention for ML researchers who’d like to…

Meta: Less Wright, Meet Vadakkanchery, Saurabh Mishra, Ela Krepska, Hamid Shojanazeri, Pradeep Fernando Crusoe: Ethan…

Meta: Less Wright, Hamid Shojanazeri, Vasiliy Kuznetsov, Daniel Vega-Myhre, Gokul Nadathur, Will Constable, Tianyu Liu,…

PyTorch 2.7 continues to deliver significant functionality and performance enhancements on Intel® GPU architectures to streamline…

We are excited to announce the release of PyTorch® 2.7 (release notes)! This release features:…

Automatic speech recognition (ASR) has revolutionized how we interact with technology, clearing the way for…