Our team is engaging Biostatisticians to contribute to a customer's advanced project in AI benchmarking. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
• Design and author expert-level evaluation tasks simulating real-world biostatistics challenges, such as clinical trial analysis, regulatory submission reviews, and observational study assessments.
• Source, construct, and curate authentic datasets including trial data, patient records, and protocol documents for task use.
• Define correct methodological solutions and defensible clinical interpretations for each evaluation scenario.
• Develop comprehensive, 35+ item rubrics to evaluate AI agent performance with respect to methodological rigor and clinical reasoning.
• Ensure all tasks reflect the complexity and depth of real-world biostatistics practice, avoiding simplified or textbook-style examples.
• Collaborate with project stakeholders to ensure deliverables align with regulatory and scientific standards.
Preferred Qualifications
• MS or PhD in biostatistics, statistics, or epidemiology.
• 4+ years of experience in pharmaceutical, contract research, hospital, or academic medical contexts.
• Demonstrated command of clinical study design, regulatory documentation, and observational research methodologies.
• Advanced proficiency in R, Python, SAS, or Stata applied to real clinical or epidemiological datasets.
• Strong attention to methodological detail, clinical interpretation, and regulatory sensitivity.
• Experience preparing submission-ready deliverables for regulatory agencies (e.g., FDA, EMA) is a plus.
• Excellent written communication skills and ability to author detailed grading rubrics and technical documentation.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.