Open role at a frontier AI lab
AI Rubric Writer
Ready to see if you fit?
Upload a resume once, then run an honest fit check on this role in seconds. Access is free and always will be.
About the role
We are seeking an experienced AI Rubric Writer to develop high-quality evaluation rubrics and scoring frameworks for AI and Large Language Model (LLM) assessments. The ideal candidate will create clear, objective evaluation criteria to assess AI-generated responses and help improve model performance across a variety of subject areas.
Responsibilities
• Design and develop evaluation rubrics and scoring guidelines for AI-generated content.
• Create objective, consistent, and well-structured assessment criteria.
• Evaluate AI responses for accuracy, reasoning, completeness, and quality.
• Provide detailed feedback to improve AI model performance.
• Collaborate with cross-functional teams to refine evaluation standards.