Responsibilities
• Design test cases that confirm each task works as intended, including tricky edge cases
• Review tasks and reference solutions before finalization, catching ambiguity and gaps early
• Debug tasks or checks in Python when they don’t behave as expected
• Help build simple, repeatable quality checklists and provide actionable feedback to authors
• Watch for shortcuts and grading gaps in AI agent runs to keep benchmark scores trustworthy

Requirements
• MSc or PhD in a STEM field, or equivalent practical experience in a research-heavy or engineering-heavy domain
• 1+ years of experience in test engineering, quality assurance, or a research/software engineering role with strong quality ownership
• Demonstrated skill designing test cases and quality-review processes, and debugging complex systems end-to-end
• Working proficiency in Python and Git, with comfort navigating unfamiliar codebases and environments
• Exceptional attention to detail and clear written documentation habits
• Perfectionist mindset with creativity in finding what others missed and ability to work independently on ambiguous problems
• Ability to engage reliably for ~35 hours per week

Preferred
• Past experience in AI training, model evaluation, or quality review of AI-generated work

How to Apply
Click "Apply" to be taken to the Mercor website. Complete your profile by uploading your resume and confirming your work location. Once verified, you will be matched to opportunities as they arise. Please note that this role cannot support H1B or STEM OPT candidates. Applying through our link supports WFH Bulletin as a referral partner, but you are welcome to apply directly if you prefer.