Open role at a frontier AI lab
211 Specialist
Ready to see if you fit?
Upload a resume once, then run an honest fit check on this role in seconds. Access is free and always will be.
About the role
Time Commitment: 10-20 hours/week, short-term project
Our team is looking for 211 Specialists to help evaluate and improve AI systems on government services topics. You’ll use your experience answering the public to check that questions sound like real callers and that answers would actually help them. Accuracy comes first. No AI experience is needed; your domain knowledge is what matters.
Scope of Work
• Review sample questions and flag any that don’t sound like what real callers ask.
• Write rubrics that define a correct, complete answer, including the right referrals and next steps for the caller.
• Evaluate AI-generated answers against your rubrics, flagging errors, omissions, outdated guidance, and answers that wouldn’t help a real caller.