Applied AI Engineer II
Microsoft · Posted Oct 14
Software, cloud computing, artificial intelligence, and hardware services
Get a personal compatibility score
Add a resume for personal matches
About the role
Microsoft's Applied AI Research team sits within Microsoft Purview, a high-impact team focused on data security, compliance, governance, and risk management, taking innovations from concept to prototype and into products. The team works on large language models, agentic systems and reasoning frameworks, and advanced machine learning solutions. As an AI Engineer, the role involves designing and delivering intelligent experiences, owning the ML/DL development cycle through production, and partnering with researchers, architects, engineers, and product leaders.
What you will do
- Design, build and maintain AI system that hosts ML Models, tools/APIs, manage state/memory, and reliably complete multi-step workflows.
- Own entire ML/DL development cycle through production, including deployment, monitoring, and live‑site reliability, with an eval-first development lifecycle.
- Define success criteria, build evaluation datasets and automated harnesses, and run human-in-the-loop reviews where needed.
- Debug AI behavior and performance using log analysis, data inspection, and model/tool-call traces, and translate failure patterns into targeted improvements.
- Establish and track AI quality metrics (e.g., accuracy, relevance, hallucination rate) and integrate them into CI/CD release gates.
- Optimize runtime performance and economics (token usage, inference cost, latency, caching, model selection/routing, batching) and implement monitoring and continuous improvement loops (online signals, drift detection, structured user feedback).
- Partner with product, design, and domain stakeholders to define use cases, acceptance criteria, and rollout plans for AI features. Live site responsibility.
Skills used in this role
What the employer is looking for
- Bachelor's Degree in Computer Science, Data Science or related technical field Should have atleast 5 years in building and maintaining ML/AI System.
- Hands on experience with MLOPs, AIOps 4+ years of experience in shipping at least 2 large scale ML/AI-based services or applications on cloud platforms (Azure, AWS, GCP, etc.)
- 4+ years technical engineering experience with coding in languages including C#, Python and Pytorch Proficiency in writing production-quality software code in one or more modern programming languages (Python, C#)
- 1-2 years of experience with LLMs and open-source GenAI frameworks, such as LangChain, LlamaIndex, Haystack, or equivalents (e.g., Transformers, AutoGen, DSPy), including agent-based orchestration, prompt engineering, retrieval-augmented generation (RAG), and fine-tuning and evaluation.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: - This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Microsoft
Microsoft Corporation is a multinational technology company that develops, licenses, and supports a wide range of software products, services, and hardware devices. Best known for its Windows operating systems, Microsoft 365 productivity suite, and Xbox gaming consoles, the company has expanded heavily into enterprise cloud computing via Azure and advanced artificial intelligence solutions. As one of the world's most valuable public enterprises, it empowers individuals and businesses globally through innovative digital transformation.
- Industry
- Software
- Company size
- 228,000+ employees
- Founded
- April 4, 1975
- Location
- Redmond, Washington, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Vice Chair and President
Recent coverage
GeekWire
Microsoft makes 'biggest bet yet' on its own silicon, unveils new AI chip to reduce reliance on Nvidia2026-10-12
Krebs on Security
Microsoft Patches More Than 1,400 Security Flaws in Massive October Update2026-10-13
Microsoft News
Introducing the new Copilot with Home, Code and Autopilot2026-09-25
Microsoft Azure Blog
Microsoft expands Azure AI and HPC infrastructure with AMD2026-07-20