Our team is engaging Developer & Infrastructure Experts to contribute to a customer's project evaluating AI-powered developer and infrastructure workflows. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
• Test and validate AI-assisted workflows for developer and infrastructure tasks using tools such as GitHub, GitLab, JIRA, AWS, Azure, GCP, Kubernetes, Docker, and Terraform.
• Assess the accuracy and relevance of AI-generated commands, configurations, and outputs within cloud and platform engineering contexts.
• Document observations, identify discrepancies, and provide detailed feedback based on your professional experience.
• Evaluate how well AI agents interact with connected platforms and workplace tools, such as Slack, Google Drive, and Microsoft 365.
• Collaborate asynchronously by submitting written evaluations and participating in virtual discussions to clarify workflow requirements.
• Recommend enhancements and flag potential issues in AI-driven processes, with a focus on real-world applicability and industry standards.
• Maintain clear written and verbal communication in all feedback and interaction with project stakeholders.
Preferred Qualifications
• Proven expertise in software engineering, DevOps, site reliability engineering (SRE), cloud, platform, or infrastructure domains.
• Hands-on experience with Azure DevOps, AWS, GCP, Kubernetes, Docker, Terraform, CI/CD tools, and observability frameworks.
• Familiarity with developer platforms and workflow management tools such as GitHub, GitLab, and JIRA.
• Professional experience using AI agents (e.g., ChatGPT, Claude Code, Claude Cowork, Codex) in conjunction with development and infrastructure tools.
• Demonstrated ability to evaluate technical processes and provide actionable feedback.
• Strong skills in both written and verbal communication, with particular care for clarity and thoroughness.
• Experience integrating or working with workplace connectors and automation tools considered a plus.