DevOps Engineer - AI Model Evaluator

About the role

We are looking for a remote DevOps Engineer to act as an AI Model Evaluator. You will work with cutting‑edge AI coding agents to assess and improve infrastructure engineering outputs generated by advanced models.

Key responsibilities

• Use frontier AI coding agents to complete and evaluate complex infrastructure tasks.
• Review model‑generated implementations across cloud platforms, Kubernetes, CI/CD systems, observability, and automation.
• Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
• Compare results from multiple AI models to determine strengths and weaknesses.
• Apply professional engineering judgment to realistic infrastructure scenarios.

Required profile

• 2+ years of professional experience in DevOps, SRE, or Cloud Engineering.
• Hands‑on experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, and observability tooling.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar.
• Ability to critically evaluate model‑generated infrastructure and reliability solutions.

Required skills

• AWS
• Azure
• Google Cloud Platform (GCP)
• Kubernetes
• Terraform
• CI/CD pipelines
• Observability tooling
• AI coding agents (Cursor, Claude Code, Codex, Windsurf, Gemini CLI)

What we offer

• Contract position with a competitive hourly rate of $85.
• Additional $400 per accepted task.
• Fully remote work environment.
• Opportunity to work with leading AI research labs.