Staff ML Compiler Engineer, TPU Performance Optimizations
Google · Posted Oct 5
Search engine, cloud computing, software, hardware, and artificial intelligence services
Get a personal compatibility score
Add a resume for personal matches
About the role
Google Cloud's software engineers develop next-generation technologies, and this team focuses on driving continuous improvements to the machine learning software/hardware stack and the TPU compiler for Google first-party teams and Google Cloud Platform (GCP) customers. In this role you will build the infrastructure powering advanced machine learning, designing and implementing compiler optimizations such as pipelining, prefetching, and fusions to maximize TPU efficiency, and collaborating across teams to integrate frameworks like PyTorch. The role spans internal Alphabet initiatives including LLM development and chip co-design, alongside empowering external cloud customers.
What you will do
- Learn and build an intuitive understanding of various parts of Google’s ML stack: Frameworks (e.g., JAX, PyTorch), XLA and runtime stack.
- Research and develop the novel compiler optimizations targeting ML workloads, and emerging architectures.
- Identify opportunities to improve the efficiency of the ML workloads through insightful performance debugging for ML workloads and custom kernels, and build compiler solutions to deliver those improvements.
- Provide technical leadership and mentorship as a Team Lead (TL), and explore strategic initiatives.
Skills used in this role
Preferred qualifications
- Experience in open-source software development, including experience in releasing and supporting open-source projects.
- Experience with ML compilers and their internals, experience writing compiler optimization passes.
- Experience with debugging correctness and performance issues at all levels of the ML Software (SW) stack.
- Experience with GPU or TPU performance analysis.
- Comfortable with accelerator Hardware (HW) architectures (TPUs/Graphics Processing Unit (GPUs)).
- Comfortable debugging correctness and performance issues at all levels of the stack.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Google
Google LLC is an American multinational technology company focusing on artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. As a subsidiary of Alphabet Inc., it is widely recognized for services like Google Search, YouTube, Android, and the Gemini AI ecosystem.
- Industry
- Internet
- Company size
- 180000+ employees
- Founded
- 1998-09-04
- Location
- Mountain View, California, USA
- Funding stage
- Public Company
Funding
Public Company · $25M raised
- 1999-06-07Series A$25M
Leadership
Chief Executive Officer
Senior Vice President and Chief Financial Officer
Senior Vice President and Chief Business Officer
Chief Executive Officer, Google Cloud
Recent coverage
Search Engine Journal
Google Rolls Out September 2026 Spam Update Globally2026-09-24
Android Headlines
Everything announced at Google's 2026 Made by Google event2026-08-24
TechRepublic
Google's Biggest Announcements of 2026: Gemini, Android 17, and More2026-08-03
Google Blog
At Google I/O 2026, we unveiled a vision for this era of the agentic web2026-05-19