
Senior And Or Principal Software Engineer AI Gpu Performance United States Multiple Locations Multiple Locations
Microsoft
Applications are made on Microsoft's own site. We never sit in the middle.
Job description
As a Senior Software Engineer: Develop and optimize GPU kernels and runtime components for state-of-the-art LLM serving performance. Profile workloads and improve latency, throughput, and hardware efficiency. Integrate robust, maintainable optimizations into production serving systems. Collaborate across model, compiler, infrastructure, and hardware teams. Contribute to technical reviews, engineering standards, and mentoring. Perform difficult, low-level optimization and resolve critical performance bottlenecks. Collaborate across research, infrastructure, and hardware teams to deliver measurable improvements. Bachelor's Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience. Expertise in GPU or equivalent accelerator programming and kernel optimization. Familiarity with vLLM, SGLang, or equivalent LLM inference libraries. Demonstrated cross-team collaboration and technical ownership. Ability to use AI-assisted development tools efficiently and validate their output. Deep expertise in GPU or equivalent accelerator compilation pipelines and low-level architecture. Expertise in LLM training and inference parallelism and acceleration. Demonstrated ownership of cross-team technical initiatives from strategy through production. Track record of creating reusable platforms, influencing senior stakeholders, and mentoring technical leaders.
Other jobs you might want
Microsoft
Data Center Program Manager United States Virginia Boydton
Boydton, VA, United States
Microsoft
Cloud Solution Architect Security India Karnataka Bangalore
Bengaluru, KA, India
Microsoft
Sr Specialist
Microsoft
Software Engineer 2 Agentic Sandbox China Shanghai Shanghai
Shanghai, China
Microsoft
Software Engineer India Karnataka Bangalore
Bengaluru, KA, India
Microsoft
Senior AI Workforce Specialist Financial Services Australia New South Wales Sydney
Sydney, NSW, Australia