Our team is seeking experienced Intelligence Operations & Collection Experts to contribute their specialized knowledge to an AI training and evaluation project focused on intelligence operations and national security.
We are particularly interested in professionals with current or previous experience within civilian intelligence agencies, such as the CIA, NSA, MI6/SIS, GCHQ, or equivalent organizations.
Scope of Work
• Evaluate AI-generated scenarios involving intelligence collection, operational planning, and national security decision-making.
• Assess the accuracy, realism, and relevance of intelligence collection methodologies and operational processes.
• Review and refine intelligence-related case studies, analytical summaries, and scenario-based materials.
• Identify gaps, inconsistencies, and unrealistic assumptions in AI-generated content.
• Provide structured feedback to improve AI reasoning and understanding of intelligence operations.
Preferred Qualifications
• Current or previous professional experience within a civilian intelligence agency, particularly in intelligence operations, collection, or collection management.
• Demonstrated expertise in HUMINT, SIGINT, OSINT, or other intelligence collection disciplines.
• Understanding of civilian intelligence agency procedures, operational frameworks, legal authorities, and interagency coordination.
• Experience in operational planning, intelligence collection requirements, or evaluating intelligence information.
• Strong analytical judgment, attention to detail, and written communication skills.
Learn More About Our Government & Defense Work
At Our team, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.