Our team is engaging Lawyer/Legal Writers to participate in an evaluation and analysis opportunity focused on advanced AI system development for a customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
This is an evaluative engagement: you will assess and analyze written legal content, not provide legal advice or representation. There is no attorney-client relationship, and your professional judgment about written argument is the core value. The focus is on those skills lawyers employ daily — discerning whether writing is precise, properly qualified, pitched to the appropriate audience, and free from unwarranted overstatement. Recognizing confidently stated but unsupported writing is central to the project.
Scope of Work
• Evaluate and compare multiple AI-generated written responses to legal and technical prompts for clarity, tone, and compliance with instructions.
• Assign analytical quality scores and compose detailed rationales for each assessment.
• Identify responses that sound authoritative but lack precision, contain overstatements, or present unsupported claims.
• Detect inconsistencies, ambiguities, or factual inaccuracies in digital content.
• Document findings and insights meticulously in online review platforms.
• Collaborate asynchronously with project managers and reviewers to ensure consistent evaluation standards.
• Work independently while managing deliverables and deadlines per project requirements.
Preferred Qualifications
• English as a first language or fully equivalent written fluency.
• Qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Background in reviewing, editing, or supervising legal writing by junior lawyers, trainees, or paralegals.
• Strong ability to assess whether content is tailored appropriately for legal, regulatory, client, or public audiences.
• Exceptional attention to detail, critical analysis, and written communication skills.
• Experience with digital document review platforms or annotation tools is desirable; familiarity with model evaluation or RLHF is a plus but not required.