Senior Software Engineer - AI/ML Infrastructure CoreAI
Microsoft · Posted Oct 22
Software, cloud computing, artificial intelligence, and hardware services
Get a personal compatibility score
Add a resume for personal matches
About the role
The Foundry Agents team within Microsoft CoreAI builds the Azure AI Foundry Customization platform that powers AI innovation across Azure and Microsoft products such as GitHub, Microsoft 365 and Xbox. The team works on pre-training, mid-training and post-training solutions, reinforcement learning for production agents, model deployment and inferencing at scale on Azure's GPU infrastructure. This role involves end-to-end ownership of services, pipelines, ML recipes and evaluations, collaborating with data scientists and IDC/US counterparts on distributed training and scalable ML infrastructure.
What you will do
- Execute independently on complex, multi-dependency, medium-high ambiguity projects
- Work closely with IDC & US team counterparts for design & code reviews, align priorities, and effectively collaborate with appropriate stakeholders
- Collaborate with key stakeholders to comprehend and identify user requirements, scope solutions, estimate work, and schedule deliverables
- Lead discussions on the design & architecture of products or solutions and apply engineering principles to establish robust and maintainable architecture
- Manage and drive feature execution with high quality and great agility
- Lead by example by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents
- Coach and develop early-career engineers and team members.
Skills used in this role
What the employer is looking for
- Bachelor's Degree in Computer Science, or Computer Engineering, or related field AND 8+ years related software engineering experience OR Master's Degree in Computer Science, or Computer Engineering, or related field AND 5+ years related software engineering experience OR equivalent experience
- Proficiency in programming languages & tools such as .Net, Java, Azure functions, Docker, Python
- Experience delivering large scale, distributed, cloud based software services
- Passion or inclination for machine learning, artificial intelligence, and data science
- Ability to work collaboratively in a team and communicate complex concepts effectively
Preferred qualifications
- Proven track record of shipping and maintaining Microsoft Azure cloud services, preferably related to serving machine learning models
- Experience with day-to-day AI agents and tool use
- Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)
- Quick learner with a passion for solving complex and exciting problems.
- Experience with AI/ML internals a big plus
- Experience with Azure is a plus
Benefits and support
- Compensation and benefits are detailed in the job posting
About Microsoft
Microsoft Corporation is a multinational technology company that develops, licenses, and supports a wide range of software products, services, and hardware devices. Best known for its Windows operating systems, Microsoft 365 productivity suite, and Xbox gaming consoles, the company has expanded heavily into enterprise cloud computing via Azure and advanced artificial intelligence solutions. As one of the world's most valuable public enterprises, it empowers individuals and businesses globally through innovative digital transformation.
- Industry
- Software
- Company size
- 228,000+ employees
- Founded
- April 4, 1975
- Location
- Redmond, Washington, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Vice Chair and President
Recent coverage
GeekWire
Microsoft unveils tools to monitor and corral rogue AI agentsOctober 19, 2026
Futurum Group
Microsoft Expands Sovereign Cloud Capabilities Across Public and Private EcosystemsOctober 20, 2026
BGR
Microsoft asks certain Xbox Series X/S owners to sell consoles back to Best Buy amid component cost pressuresOctober 20, 2026