
Software Engineer, Systems ML: PyTorch Distributed
Meta · Menlo Park, CA
Applications are made on Meta's own site. We never sit in the middle.
Job description
In this role, you will be a member of the PyTorch Distributed team. The PyTorch team develops the open source software stack powering AI models and systems. The Distributed team builds the foundational infrastructure, APIs, kernels, tools, and recipes for enabling fast and reliable distributed training in PyTorch as well as in TorchTitan, the PyTorch-native framework for LLM pretraining and post-training. In this role, you will work closely with AI researchers & infrastructure engineers within Meta and from the open-source community to optimize distributed training using PyTorch. A sample of the team’s recent work is highlighted in the following blogs: TorchTitan ([https://pytorch.org/blog/torchtitan-update-new-sota-models-performance-at-scale-titanrl/](https://pytorch.org/blog/torchtitan-update-new-sota-models-performance-at-scale-titanrl/)), DistMoE ([https://meta-pytorch.org/dist_moe/previews/visual-explainer/](https://meta-pytorch.org/dist_moe/previews/visual-explainer/)), OLMO3 reproduction ([https://docs.pytorch.org/devlogs/distributed/2026-09-02-olmo3-reproduction/](https://docs.pytorch.org/devlogs/distributed/2026-09-02-olmo3-reproduction/)).
Other jobs you might want
Meta
Product Policy Manager, Messaging
Menlo Park, CA
Meta
Product Risk Program Manager - Product Enablement
Menlo Park, CA
Meta
Product Marketing Manager, Generative AI
Menlo Park, CA
Meta
Capacity Delivery Lead, Data Center Infrastructure
Remote, US
Meta
Commercial Sourcing Manager, Memory and Storage
Bellevue, WA
Meta
Data Center Planning Lead
Menlo Park, CA