Responsibilities
• Guide research and program teams to close the gap between ambiguous requirements and rater-ready instructions
• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps
• Translate program specifications from domains such as finance, retail, insurance, legal and sports into precise rater instructions
• Collaborate with subject matter experts and program leads to ensure consistency across guideline sets

Requirements
• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field with direct experience writing or refining guidelines or rubrics for human raters in a GenAI or RLHF context
• Demonstrated ability to work across multiple subject-matter domains and translate nuance into clear, unambiguous instructions
• Strong track record of resolving ambiguity and contradiction in written specifications
• Demonstrable career progression
• Ability to engage reliably for at least 35 hours per week during weekdays
• Strong written communication skills and ability to explain complex guidance clearly and precisely

How to Apply
Click "Apply" to be taken to the Cincinnatus LLC application. This is a W-2 contingent role with the opportunity to be placed at a leading AI lab.