Quality Analyst
Roblox · Posted Nov 5
Online gaming platform, 3D virtual experiences, and developer tools
Get a personal compatibility score
Add a resume for personal matches
About the role
Roblox is a global platform where millions of people explore, create, play, and connect through 3D immersive experiences built by its community of developers and creators. The company builds the tools and platform behind those experiences, with a focus on safety and civility at scale. This Quality Analyst role supports Trust & Safety quality operations — maintaining answer keys for image moderation, auditing disputed and sampled cases, calibrating vendor QA teams, and reporting accuracy metrics to stakeholders.
What you will do
- Build and maintain the answer key. Use your policy and enforcement expertise to create correctly labeled image cases for moderator training, QA, and policy work. Add new cases as policies and content trends change.
- Make final calls on disputed decisions. Blind-audit sampled cases and resolve disagreements between moderators, vendor QA, and automated systems.
- Calibrate vendor QA teams. Measure vendor auditors’ accuracy against the answer key and lead calibration sessions to close gaps.
- Find root causes and trends. Tag every error using a standard error taxonomy, and analyze quality data to find patterns, bottlenecks, and ways to improve. Flag new risks early and run deep dives on the biggest problems.
- Recommend fixes. Write short briefs for weekly stakeholder reviews. Each brief should size the problem, describe its impact, and name the team best placed to fix it.
- Report on quality. Pull statistically valid samples and publish weekly quality reports with accuracy metrics and confidence intervals.
- Use outside quality signals. Include data from user appeals, escalations, partner feedback, and customer support to get a fuller picture of quality.
- Confirm that fixes worked. Audit affected queues again after each change to check that quality improved.
Skills used in this role
What the employer is looking for
- 3+ years in quality assurance, content moderation, Trust & Safety, or a related operations role
- A strong understanding of content policy, plus sound judgment on close calls
- Experience building answer keys, test sets, or calibration materials
- Experience auditing and calibrating reviewers, including outsourced or vendor teams
- Working knowledge of sampling and basic statistics, including accuracy rates, inter-rater agreement, and confidence intervals
- Experience doing root-cause analysis and turning findings into practical recommendations
- Skill with spreadsheets for pulling and analyzing data
- Clear written and verbal communication, including writing short summaries for leadership
- Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors
Benefits and support
- Compensation and benefits are detailed in the job posting
About Roblox
Roblox operates an immersive online platform where users can build, share, and play 3D experiences created by a global community of developers. The company's mission is to bring the world together through play, enabling tens of millions of daily active users to socialize, learn, and work in virtual environments.
- Industry
- Gaming
- Company size
- 2000+ employees
- Founded
- 2004
- Location
- San Mateo, California, USA
- Funding stage
- Public Company
Funding
Public Company · $918M raised
- 2021-01-06Series H$520M
- 2020-02-26Series G$150M
Leadership
Founder and Chief Executive Officer
Naveen Chopra
Chief Financial Officer
Chief Marketing Officer
Mark Reinstra
Chief Legal Officer
Enrico D'Angelo
Chief Business Officer
Recent coverage
GamesIndustry.biz
Roblox Q3 results beat expectations despite bookings falling 12% to $1.7bn2026-10-30
Business Wire
Roblox Unveils New Ways to Play, Build, and Grow at the Roblox Developers Conference (RDC)2026-09-11
Business Wire
Roblox Creators Added $752 Million to the U.S. Economy in 2025, a 69% Increase From 20242026-09-03
Roblox Blog
Roblox Introduces Build: A New Way to Create on the Platform2026-07-16