
AI/ML Hardware Architect, Cloud, Silicon
Google · Posted Nov 8
Search engine, cloud computing, software, hardware, and artificial intelligence services
Get a personal compatibility score
Add a resume for personal matches
About the role
The AI and Infrastructure team delivers AI and Infrastructure at hyperscale for Googlers, Google Cloud customers, and billions of Google users, spanning TPUs, Vertex AI, Google Global Networking, data center operations, and systems research. The team develops custom silicon and hardware/software platforms that power Google's AI models and direct-to-consumer products. This role develops architecture specifications and microarchitectural power/performance models for AI/ML accelerator silicon, driving hardware/software co-design with compiler, ML model, research, and design teams.
What you will do
- Develop architecture specifications that meet current and future computing requirements for AI/ML roadmap. Develop architectural and microarchitectural power/performance models, microarchitecture and evaluate quantitative and qualitative performance and power analysis.
- Partner with hardware design, software, compiler, Machine Learning (ML) model and research teams for effective hardware/software co-design, creating high performance hardware/software interfaces. Evaluate different silicon solutions for executing Google's data center Artificial Intelligence (AI) accelerator roadmap, components, vendor co-developments, custom designs and chiplets.
- Create high performance hardware/software interfaces.
- Collaborate with software, verification, emulation, physical design, packaging and silicon validation stakeholders to ensure designs are complete, correct and performant.
- Own microarchitecture of compute blocks and subsystems. Identify and drive power, performance and area improvements for the modules owned. Develop and contribute to the simulations tools.
Skills used in this role
What the employer is looking for
- Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
- 4 years of experience in any one of the following areas: architecture and micro-architecture design of graphics, Machine Learning (ML), or managing low-precision or mixed-precision numerics, vector processors, DSP processors, or architecting networking ASICs.
- Experience in memory hierarchy, memory controllers, High Bandwidth Memory (HBM), and Dynamic Random-Access Memory (DRAM) technologies.
Preferred qualifications
- Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture.
- Experience working with software teams optimizing the hardware/software interface.
- Experience in estimating performance by analysis, modeling, and network simulation in defining and driving performance test plans.
- Experience in programming languages (e.g., C++, Python).
- Knowledge of arithmetic units, bus architectures, accelerators or memory hierarchies and high performance and low power design techniques.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Google
Google LLC is an American multinational technology company focusing on artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. As a subsidiary of Alphabet Inc., it is widely recognized for services like Google Search, YouTube, Android, and the Gemini AI ecosystem.
- Industry
- Internet
- Company size
- 180000+ employees
- Founded
- 1998-09-04
- Location
- Mountain View, California, USA
- Funding stage
- Public Company
Funding
Public Company · $25M raised
- 1999-06-07Series A$25M
Leadership
Chief Executive Officer
Senior Vice President and Chief Financial Officer
Senior Vice President and Chief Business Officer
Chief Executive Officer, Google Cloud
Recent coverage
India Today
Google offers voluntary exits to employees in 5 countries as AI spending rises2026-11-05
CNN
Google is rolling out new controls for schools to limit students' access to the company's AI tools2026-11-03
Google Blog
October 2026 updates represent significant advancements in model capabilities, development tools, and hardware infrastructure2026-11-02
TechRepublic
Google's Biggest Announcements of 2026: Gemini, Android 17, and More2026-08-03