Director of Engineering (AI Inference Platform)
Arm · Posted Nov 4
Semiconductor IP, energy-efficient CPU architecture, and high-performance compute platforms
Get a personal compatibility score
Add a resume for personal matches
About the role
Arm is hiring a Director of Engineering to establish a new India team for its AI inference platform. The team will work on production inference services, addressing demands from long-context and agentic workloads on memory, compute, and response time. The role sets engineering strategy, builds an organization of approximately 20 people, and leads architecture, performance, efficiency, and reliability work in partnership with US and UK teams.
What you will do
- Set the engineering strategy for the India organization. Identify the capabilities it should lead, make investment choices, and translate platform priorities into a roadmap that can adapt as the technology develops.
- Recruit and develop the technical leadership and engineering expertise needed to deliver that strategy. Shape the organization as its responsibilities grow, and build a record of developing talent alongside hiring it.
- Establish an engineering approach suited to a team tackling an evolving platform, using AI throughout development and keeping the path from an idea to a reliable release short.
- Lead architecture decisions with enough technical depth to challenge assumptions and evaluate new approaches. Help teams make progress on unfamiliar systems problems through experimentation and sound engineering judgment.
- Give engineering leaders clear responsibility for complete platform capabilities, including their operation in production. Coach them to make decisions and build teams that can deliver independently.
- Partner with Arm teams in the US and UK to shape platform direction, agree ownership, and resolve dependencies. Represent the India organization's priorities in broader engineering and planning decisions.
Skills used in this role
What the employer is looking for
- Experience building engineering organizations, including recruiting senior talent and developing managers and technical leaders.
- A record of setting technical strategy, choosing priorities, and delivering production software as requirements and technology change.
- Technical depth in distributed systems, AI infrastructure, performance engineering, or related platform software, with the ability to assess architecture and guide difficult decisions.
- Understanding of AI inference and the relationship between workload, hardware, and system performance.
- Practical experience improving software development with AI, supported by judgment about quality and reliability.
- Experience leading across organizational and geographic boundaries, with clear ownership and productive technical partnerships.
Preferred qualifications
- Inference engines, accelerator-based systems, or tools for profiling and tuning model performance.
- Kubernetes, cloud platforms, or software deployed across different compute environments.
- Distributed tracing, large-scale data processing, or usage accounting systems.
- Establishing an engineering team in India and recruiting senior technical talent locally.
Benefits and support
- Hybrid working
About Arm
Arm architects, develops, and licenses high-performance, energy-efficient CPU products and related semiconductor intellectual property. Its technology powers over 99% of the world's smartphones as well as a vast array of devices ranging from tiny sensors and wearables to cloud-scale AI supercomputers.
- Industry
- Semiconductors
- Company size
- 8000+ employees
- Founded
- 1990
- Location
- Cambridge, United Kingdom
- Funding stage
- Public Company
Funding
Public Company
- 2023-09-14IPO$5.23B
Leadership
Chief Executive Officer, Board Member
Executive Vice President and Chief Financial Officer
Executive Vice President, Chief Legal Officer and Head of Corporate Development
Executive Vice President and Chief Commercial Officer
Executive Vice President and Chief Architect
Recent coverage
Arm Newsroom
Arm Q2 FYE27 quarterly earnings mark fifth consecutive quarter of total revenue growth exceeding 20% year over year2026-11-04
Investing.com
Arm stock slips after hours as lack of blowout guidance offsets quarterly results2026-11-05
TradingView
Key facts: Arm's $2B AI CPU; 50%+ server share; $290.70 target2026-11-05