Senior AI Interaction Evaluator (Codex/Claude)

About the role

We are seeking a senior‑level software engineer to assess the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on judging whether the model’s responses reflect the thinking of a strong engineer, rather than writing production code.

Key responsibilities

• Evaluate end‑to‑end AI‑generated coding interactions for usefulness, high‑level correctness, and engineering judgment.
• Assess explanations, reasoning, and preambles for clarity and relevance.
• Distinguish between different quality levels of responses and assign consistent ratings.
• Provide clear, opinionated feedback on what worked, what didn’t, and any misleading aspects.
• Help define standards for great interactions with AI‑first development tools.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line and to give direct, rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Hourly rate up to $200 USD (US/Canada), $150 USD (EU/Latam), $100 USD (other locations).
• 10–20 hours per week, contract through early May with possible extension.
• Remote work, start ASAP.