Software Development Manager - ML Compiler, AWS Neuron, Annapurna Labs

Overview

Software Development Manager - ML Compiler, AWS Neuron, Annapurna Labs. The AWS Neuron SDK includes an ML compiler, runtime and integration with popular ML frameworks (PyTorch, TensorFlow, MxNet). The Neuron SDK optimizes performance of neural net models on AWS Inferentia and Trainium, enabling high performance, low cost, and ease of use for customers.

The Annapurna Labs team builds silicon and software for AWS customers, combining cloud scale with an agile, learning culture. The team spans silicon engineering, hardware design and verification, software and operations, and emphasizes innovation, experimentation, and cross-product collaboration.

Explore product and resources:

Role focus: As a Manager III on the AWS Neuron team, you will lead a team of compiler engineers through developing, deploying, and scaling a compiler for AWS Inferentia and Trainium. You will work closely with AWS ML services teams, contribute to pre-silicon design, and bring new products, optimizations and features to market to meet customer needs for performance, cost and usability.

You will have deep knowledge of resource management, scheduling, code generation, optimization, and new instruction architectures including CPU, NPU, GPU and novel compute forms.

Location: In order to be considered for this role, candidates must be located in or willing to relocate to Toronto.

Key responsibilities

• Lead and mentor a team of compiler engineers through the full software lifecycle: design, development, deployment, and scaling of the compiler for AWS Inferentia and Trainium.
• Collaborate with AWS ML services teams, participate in pre-silicon design, and drive new products, optimizations and features.
• Ensure Neuron SDK delivers high performance, low cost, and ease of use for customers.
• Contribute to resource management, scheduling, code generation, optimization, and support for new instruction architectures (CPU, NPU, GPU, etc.).
• Engage with customers and partners to understand needs and translate them into technical initiatives.

Basic Qualifications

• 3+ years of engineering team management experience
• 6+ years of experience working directly within engineering teams
• 4+ years of designing or architecting systems with reliability and scalability considerations
• Experience partnering with product or program management teams
• Excellent software design fundamentals and deep understanding of compilers (resource management, instruction scheduling, code generation, compute graph optimization)

Preferred Qualifications

• M.S. or Ph.D. in Computer Science or related technical field
• Experience with toolchains (LLVM, GCC) and code generation techniques for new hardware
• Knowledge of compiler internals from front end to run-time with emphasis on AI acceleration

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you require a workplace accommodation during the application or hiring process, including support for the interview or onboarding, visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.