Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This is a contract position focused on assessing how well the model mimics the reasoning and judgment of an experienced developer, rather than writing production code.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and alignment with strong engineering judgment.
• Assess explanations, reasoning, and preambles for clarity and relevance.
• Distinguish between different quality levels of responses and provide clear, opinionated feedback.
• Help define standards for what great AI‑assisted coding interactions look like.
• Collaborate with the team to refine evaluation criteria and improve tool trustworthiness.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a high bar for good engineering.
• Strong background in at least one of: TypeScript, JavaScript, or Python.
• Hands‑on experience using OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code and reasoning without fully executing every line.
• Comfortable delivering direct, subjective yet rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Hourly rate up to $200 USD for US/Canada, $150 EUR for EU/Latam, $100 USD for other locations.
• 10–20 hours per week, remote work.
• Contract through early May with possible extension.
• Start immediately; simple take‑home evaluation and one behavioral interview.