Senior / Staff Software Engineer (AI Platforms)
Arm · Posted Nov 6
Semiconductor IP, energy-efficient CPU architecture, and high-performance compute platforms
Get a personal compatibility score
Add a resume for personal matches
About the role
Arm is building the software infrastructure for next-generation AI inference and compute platforms, spanning distributed systems, model serving, workload orchestration, and reliable AI workloads at scale. The role will own significant platform capabilities, design and implement distributed infrastructure, improve performance and reliability, and collaborate across Arm on architecture and technical decisions.
What you will do
- Design and implement distributed infrastructure for AI inference, including model serving, request routing, workload scheduling, and resource management.
- Build reliable, high-performance software, solving problems involving concurrency, networking, scalability, data consistency, and failure recovery.
- Own software capabilities end to end, from evaluating design options and writing code to testing, deployment, debugging, and ongoing improvements.
- Investigate system bottlenecks through profiling, benchmarking, and diagnostics. Improve latency, throughput, resource efficiency, and reliability.
- Use and extend AI-assisted development tools and agentic workflows to improve engineering productivity, with appropriate testing, verification, and code review.
- Collaborate with engineers across Arm on architecture, interfaces, and technical decisions.
- Contribute to code reviews, engineering practices, and the development of a growing team.
Skills used in this role
What the employer is looking for
- 5+ years of software engineering experience building complex software systems, with demonstrated technical depth, ownership, and impact.
- Strong programming skills in C++, Go, Rust, Python, or comparable languages, with solid foundations in algorithms, data structures, and software design.
- Strong understanding of distributed systems, including concurrency, networking, service interfaces, state management, and fault tolerance.
- Experience developing and debugging software on Linux, cloud infrastructure, or container-based environments, with an understanding of system performance and reliability.
- Hands-on experience with AI-assisted development tools, including evaluating, debugging, and validating AI-generated code.
- Strong problem-solving skills, sound technical judgment, and the ability to work independently through unfamiliar or ambiguous engineering problems.
- We are considering candidates at both Senior and Staff levels. Senior engineers should demonstrate strong technical execution and ownership of complex components. Staff engineers should also demonstrate the ability to lead significant technical designs, make architectural tradeoffs, and influence engineering decisions across teams.
Preferred qualifications
- Experience with AI inference infrastructure, LLM serving, distributed compute, or ML platforms, including batching, caching, or model execution.
- Experience with Kubernetes, distributed scheduling, resource orchestration, or infrastructure that manages workloads across compute environments.
- Experience with performance profiling, benchmarking, distributed tracing, and diagnosing complex system behavior.
- Experience building developer tools, automated testing infrastructure, CI/CD systems, or agentic development workflows.
- Prior AI inference experience is valuable but not required for engineers with strong distributed systems backgrounds.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Arm
Arm architects, develops, and licenses high-performance, energy-efficient CPU products and related semiconductor intellectual property. Its technology powers over 99% of the world's smartphones as well as a vast array of devices ranging from tiny sensors and wearables to cloud-scale AI supercomputers.
- Industry
- Semiconductors
- Company size
- 8000+ employees
- Founded
- 1990
- Location
- Cambridge, United Kingdom
- Funding stage
- Public Company
Funding
Public Company
- 2023-09-14IPO$5.23B
Leadership
Chief Executive Officer, Board Member
Executive Vice President and Chief Financial Officer
Executive Vice President, Chief Legal Officer and Head of Corporate Development
Executive Vice President and Chief Commercial Officer
Executive Vice President and Chief Architect
Recent coverage
Arm Newsroom
Arm Q2 FYE27 quarterly earnings mark fifth consecutive quarter of total revenue growth exceeding 20% year over year2026-11-04
Investing.com
Arm stock slips after hours as lack of blowout guidance offsets quarterly results2026-11-05
TradingView
Key facts: Arm's $2B AI CPU; 50%+ server share; $290.70 target2026-11-05