Software Engineer II - AI/ML Infrastructure CoreAI
Microsoft · Posted Nov 4
Software, cloud computing, artificial intelligence, and hardware services
Get a personal compatibility score
Add a resume for personal matches
About the role
The AI Platform organization at Microsoft CoreAI, specifically the Azure AI Foundry Customization team, builds the platform that powers AI innovation across Azure and Microsoft's flagship products such as GitHub, Microsoft 365, and Xbox. The team works on pre-training, mid-training, and post-training solutions, reinforcement learning controls, Azure ML flexibility, LoRA model deployment, and large-scale inference backed by Azure data centers and GPU infrastructure. This role carries end-to-end ownership from high-level APIs down to granular RL controls, delivering services, pipelines, ML recipes, evaluations, and integrations for production AI systems.
What you will do
- Independently use appropriate AI agents, skills, and practices across the software development lifecycle.
- Work with appropriate internal stakeholders to understand customer/user requirements for a set of features
- Create a clear test strategy that ensures solution quality, executes test plans, and builds testable code.
- Create extensible and maintainable product feature code for minimal defects.
- Review product feature code to ensure it contains the correct test coverage and follows team standards. Implements debugging tools, tests, logs, and telemetry to verify assumptions.
- Strive for automation within production deployment aiming for zero-touch when possible.
- Apply security best practices to achieve security hardening across product features.
Skills used in this role
What the employer is looking for
- Bachelor's / Master’s Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, or Python OR equivalent experience.
- Experience with day-to-day AI agents and tool use
- Experience with AI/ML internals a big plus
- Experience writing production code in building internet scale services and distributed systems.
- Ability to debug, read code and work on a large and increasing codebase.
- Excellent communication and presentation skills.
- Engineering knowledge of machine learning systems and data pipelines, a plus.
- Experience collaborating with developers (and other stakeholders) and being a team player.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Microsoft
Microsoft Corporation is a multinational technology company that develops, licenses, and supports a wide range of software products, services, and hardware devices. Best known for its Windows operating systems, Microsoft 365 productivity suite, and Xbox gaming consoles, the company has expanded heavily into enterprise cloud computing via Azure and advanced artificial intelligence solutions. As one of the world's most valuable public enterprises, it empowers individuals and businesses globally through innovative digital transformation.
- Industry
- Software
- Company size
- 228,000+ employees
- Founded
- April 4, 1975
- Location
- Redmond, Washington, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Vice Chair and President
Recent coverage
FOX Business
Microsoft offers voluntary buyouts to 60,000 employees as tech giant reshapes its workforce2026-10-28
The Guardian
Microsoft to reportedly offer buyouts to 60,000 employees in latest cuts2026-10-26
GeekWire
Microsoft makes new 'voluntary exit' offer to about a quarter of its workforce, including some execs2026-10-26
Forbes
Microsoft is offering buyout packages to roughly 60,000 employees amid massive AI push2026-10-26