Sr. Machine Learning Compiler Engineer, Annapurna Labs

Overview

The Product: AWS Machine Learning accelerators are at the forefront of cloud innovation and power some of the most advanced Generative AI applications on AWS. Our custom silicon – including the Inferentia chip for ML inference and the Trainium chip for ML training – delivers industry-leading performance and cost efficiency at scale. These are powered by the AWS Neuron Software Development Kit (SDK), which includes a deep learning compiler, runtime, and native integration with popular ML frameworks like PyTorch, TensorFlow, and MXNet. Customers such as Snap, Autodesk, Amazon Alexa, and Amazon Rekognition are already benefiting from this technology at scale – and we’re just getting started. The Opportunity – Tel Aviv: We\'re excited to expand the AWS Neuron team to a new engineering site in Tel Aviv. This is a unique opportunity to be part of the founding team, shaping our culture and technical direction locally while contributing to a global mission. The Tel Aviv team will play a key role in developing the Neuron compiler stack – translating high-level neural network models into high-performance execution on AWS custom hardware.

Key job responsibilities

The Team: As part of Amazon Annapurna Labs, the AWS Neuron team spans software, hardware, and silicon engineering disciplines. We work closely with AWS service teams and contribute directly to the performance and scalability of ML workloads across the cloud. Our focus: creating a robust, high-performance toolchain that accelerates innovation in Generative AI.

You: As a Senior Machine Learning Compiler Engineer in Tel Aviv, you’ll lead the development of cutting-edge compiler technologies, optimize large-scale ML workloads, and bring new hardware to life. You’ll have the opportunity to influence architecture, mentor other engineers, collaborate with AWS services teams, and work on projects that span the full product lifecycle – from pre-silicon design to production. A background in ML, compilers, or AI accelerators is a plus – but above all, we\'re looking for passionate engineers eager to innovate at scale.

A day in the life: As a Sr. Machine Learning Compiler Engineer on the AWS Neuron team, you will be a thought leader supporting the ground-up development and scaling of a compiler to handle the world\'s largest ML workloads. Architecting and implementing business-critical features, publish cutting-edge research, and mentoring a brilliant team of experienced engineers excites and challenges you. You will leverage your technical communications skill as a hands-on partner to AWS ML services teams and you will be involved in pre-silicon design, bringing new products/features to market, and many other exciting projects. A background in Machine Learning and AI accelerators is preferred, but not required.

About the team