Business Analyst II
Microsoft · Posted Sep 16
Software, cloud computing, artificial intelligence, and hardware services
Get a personal compatibility score
Add a resume for personal matches
About the role
Microsoft AI is a customer-first organization focused on building AI-powered products that help customers and businesses achieve more in an evolving technology landscape. As a member of the Microsoft AI Monetization Platform Trust & Safety team, the role ensures products and platforms remain safe, trustworthy, and effective across trust and safety, fraud and abuse prevention, risk management, and AI-driven decision making. The Business Analyst II partners with Engineering, Data Science, Research, Operations, Policy, Risk, and Business stakeholders to define and deliver scalable solutions that protect users, customers, advertisers, and the broader ecosystem.
What you will do
- Partner with Policy, Engineering, Data Science, and Operations teams to develop scalable policy solutions that improve ecosystem safety, trust, and quality.
- Define and evolve policy frameworks, reviewer guidelines, decision criteria, and operational playbooks to drive consistency and enforcement quality.
- Translate policy requirements into operational processes, product requirements, evaluation frameworks, and scalable enforcement mechanisms.
- Drive policy-to-model enablement by partnering with engineering and data science teams to improve AI- and ML-powered review, detection, and enforcement systems.
- Generate insights from labeling, evaluation, audit, and operational data to identify quality gaps, emerging risks, policy ambiguities, and opportunities for improvement.
- Perform hands-on labelling, content review, evaluation, and adjudication activities as needed to establish ground truth, validate evaluation methodologies, calibrate quality standards, and improve model performance.
- Define quality metrics, evaluation methodologies, and feedback loops to continuously improve human review and automated decision-making systems.
- Partner with vendor and review operations teams to improve annotation quality, reviewer effectiveness, operational efficiency, and policy comprehension.
- Drive cross-functional initiatives from problem definition through execution, balancing customer experience, operational needs, policy intent, and business objectives.
- Communicate insights, recommendations, and policy decisions effectively to technical and non-technical stakeholders.
- Embody Microsoft's Culture and Values.
Skills used in this role
What the employer is looking for
- Bachelor's degree in business, Public Policy, Communications, Operations, Economics, Psychology, Social Sciences, Data Science, Analytics, Computer Science, or a related field, or equivalent practical experience.
- 3+ years of experience in Product Management, Program Management, Trust & Safety, Policy Operations, Risk Management, Fraud Prevention, Content Moderation, Marketplace Integrity, or related domains.
- Experience developing, interpreting, operationalizing, or enforcing policies, guidelines, standards, or business rules in complex operational environments.
- Strong analytical and problem-solving skills, with experience leveraging data to drive decisions, identify opportunities, and improve quality and operational outcomes.
- Experience working across cross-functional teams, including Engineering, Data Science, Operations, Policy, and Business stakeholders.
- Experience designing or managing review workflows, quality programs, labeling operations, evaluation frameworks, or operational processes at scale.
- Strong communication, stakeholder management, and influencing skills, with the ability to drive alignment across diverse teams.
- Familiarity with AI/ML-powered systems and the role of human review, labeling, evaluations, and feedback loops in improving model quality and safety outcomes.
Preferred qualifications
- Experience working in large-scale Trust & Safety, Marketplace Integrity, Fraud Prevention, Online Safety, Risk Management, Compliance, or similar ecosystems.
- Experience designing and scaling human review, labeling, policy enforcement, quality assurance, or evaluation programs that support operational and product outcomes.
- Experience supporting AI/ML model development through labeling strategies, ground-truth creation, adjudication frameworks, evaluation design, and feedback loops.
- Familiarity with Generative AI, Agentic AI, Large Language Models (LLMs), and human-in-the-loop systems used to improve safety, quality, and operational effectiveness.
- Experience generating actionable insights from large-scale operational, quality, labeling, or enforcement datasets and translating findings into policy, process, tooling, or product improvements.
- Working knowledge of SQL, Power BI, Python, or similar analytics, reporting, and experimentation tools.
- Demonstrated success leading cross-functional initiatives involving Engineering, Da...
Benefits and support
- Compensation and benefits are detailed in the job posting
About Microsoft
Microsoft Corporation is a multinational technology company that develops, licenses, and supports a wide range of software products, services, and hardware devices. Best known for its Windows operating systems, Microsoft 365 productivity suite, and Xbox gaming consoles, the company has expanded heavily into enterprise cloud computing via Azure and advanced artificial intelligence solutions. As one of the world's most valuable public enterprises, it empowers individuals and businesses globally through innovative digital transformation.
- Industry
- Software
- Company size
- 228,000+ employees
- Founded
- April 4, 1975
- Location
- Redmond, Washington, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Vice Chair and President
Recent coverage
Windows Central
Microsoft Announces Windows 11 Version 26H2 and Previews Next-Gen AI Features2026-10-04
Barchart
Wells Fargo Adds Microsoft to Q4 Tactical Ideas List With Street-High Target2026-10-06
The Official Microsoft Blog
Microsoft 365 and LinkedIn Leadership Update Issued by Satya Nadella2026-10-01