About the Role
We’re looking for a sharp, experienced Lead Spreadsheet Quality Analyst to oversee the accuracy and consistency of our spreadsheet evaluation data for AI training.
You’ll act as the quality gatekeeper for Excel-based annotation tasks, reviewing the work of Level 1 annotators, providing feedback, and maintaining strict programmatic verification (PV) standards that ensure our models learn from clean, unambiguous data.
This role blends technical precision with people leadership. You’ll mentor reviewers, refine QC processes, and audit datasets that shape how AI agents reason through complex spreadsheet tasks.
Note: This is a contract role with hours aligning to 10am-5pm PST.
Responsibilities
Review, approve, or reject annotated spreadsheet tasks for programmatic verification (PV) compliance
Provide detailed, actionable feedback to Level 1 annotators and help them improve their accuracy and speed
Define, refine, and document quality control guidelines and edge-case examples
Audit datasets for internal consistency and escalate structural or tooling issues to the product and research teams
Maintain weekly throughput and quality targets while ensuring annotation teams meet benchmark standards
Qualifications
3+ years in QA, data operations, analytics, or data labeling
Expert Excel user with formula auditing and debugging experience
Familiar with quality frameworks or annotation pipelines
Comfortable writing clear feedback and coaching others
Bonus
Familiarity with evaluation datasets or ML training data
Experience working in a startup environment
The Details
Location: Remote!
Compensation: $50 per hour + bonuses based on high quality task completion. Total expected compensation of $75 per hour
Hours: 10am-5pm PST. Additional hours may be requested if needed
What makes us interesting
Small, elite team of ex-founders, researchers from top AI Labs, top CS grads, and engineers from top companies
True ownership You will not be blocked by bureaucracy, shipping meaningful work within weeks rather than months
Serious momentum We're well-funded by top investors, moving fast, and focused on execution
What we do
Ship consumer products powered by cutting-edge AI research, and
Build infrastructure that facilitates research and product, and
Innovate cutting-edge research that will open up new consumer product forms
