Responsibilities
• Design challenging, real-world ML and NLP problems that target specific capability gaps in frontier AI models
• Integrate tasks into an agentic development environment using Python
• Evaluate model performance on assigned tasks
• Identify tasks where models fail and classify the nature of the failure
• Collaborate with other subject matter experts to keep evaluations consistent and accurate

Requirements
• Deep, hands-on experience in machine learning and/or natural language processing from industry, research, or graduate/PhD work
• Working proficiency in Python applied in research, industry or open-source work
• Strong command of modern ML and NLP methods including model training and evaluation, transformers and large language models
• Ability to engage reliably for approximately 20 hours per week
• Strong written communication and ability to work independently and manage your own time
• Past experience in AI training, model evaluation, or data annotation is preferred

How to Apply
Click "Apply" to be taken to the Cincinnatus LLC application. This is a part-time W-2 role with the opportunity to be placed at a leading AI lab.