Senior AI/ML Hardware Architect, Google Cloud
Google · Posted Oct 19
Search engine, cloud computing, software, hardware, and artificial intelligence services
Get a personal compatibility score
Add a resume for personal matches
About the role
The AI and Infrastructure team at Google builds AI and infrastructure at hyperscale, including custom TPU silicon, networking, data center operations, and platforms for AI models and cloud customers. This role is a senior hardware architecture position focused on defining and path-finding next-generation TPUs, including specializations such as graphics, ML, scale-up/out fabrics, low/mixed-precision numerics, vector processors, and DSP processors. The architect will develop specifications and performance/power models, own compute block microarchitecture, and drive hardware/software codesign with design, software, compiler, and ML teams.
What you will do
- Develop architecture specifications that meet current and future computing requirements for AI/ML roadmap. Develop architectural and microarchitectural power/performance models, microarchitecture and evaluate quantitative and qualitative performance and power analysis.
- Own microarchitecture of compute blocks and subsystems and partner with hardware design, software, compiler, Machine Learning (ML) model and research teams for effective hardware/software codesign, creating high performance hardware/software interfaces.
- Evaluate different silicon solutions for executing Google’s data center Artificial Intelligence (AI) accelerator roadmap, components, vendor co-developments, custom designs and chiplets.
- Create high performance hardware/software interfaces and collaborate with software, verification, emulation, physical design, packaging and silicon validation stakeholders to ensure designs are complete, correct and performant.
- Identify and drive power, performance and area improvements for the modules owned and develop and contribute to the simulations tools.
Skills used in this role
Preferred qualifications
- Master's degree or PhD in Computer Engineering, Electrical Engineering, or equivalent practical experience.
- Experience working with software teams optimizing the hardware/software interface.
- Experience in performance analysis and modeling, defining and driving performance test plans.
- Experience in programming languages (e.g., C++, Python).
- Knowledge of arithmetic units, bus architectures, accelerators or memory hierarchies and high performance and low power design techniques and use of ML tools for building smarter tools.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Google
Google LLC is an American multinational technology company focusing on artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. As a subsidiary of Alphabet Inc., it is widely recognized for services like Google Search, YouTube, Android, and the Gemini AI ecosystem.
- Industry
- Internet
- Company size
- 180000+ employees
- Founded
- 1998-09-04
- Location
- Mountain View, California, USA
- Funding stage
- Public Company
Funding
Public Company · $25M raised
- 1999-06-07Series A$25M
Leadership
Chief Executive Officer
Senior Vice President and Chief Financial Officer
Senior Vice President and Chief Business Officer
Chief Executive Officer, Google Cloud
Recent coverage
Google Blog
Project Suncatcher: Testing AI Compute in Space2026-09-24
Android Headlines
Everything announced at Google's 2026 Made by Google event2026-08-24
TechRepublic
Google's Biggest Announcements of 2026: Gemini, Android 17, and More2026-08-03