About the role
Circle is hiring a Lead Engineer for its AI Quality engineering team, which builds infrastructure to measure and improve production AI features rather than conduct ML research or model training. The role combines hands-on engineering with leadership of the team and ownership of its technical direction and priorities.
You’ll build evaluation pipelines, scorers, datasets, annotation workflows, and observability tooling for AI agents. You’ll diagnose failures across planning and tool use, run experiments on prompts and models, and pursue cost and latency improvements. The role works closely with AI Core engineering to establish whether product changes improve quality. Circle seeks experience shipping production software, complex tool-using agents, and evaluation or observability systems for AI/ML. Python is a plus; Ruby on Rails is used in production.
Highlights
- Remote role listed for Europe, the Middle East, Africa, and Asia-Pacific.
- Lead and manage the AI Quality engineering team while remaining hands-on.
- Build evaluation and diagnostic infrastructure for production AI agents.
- Compensation is described as U.S.-benchmarked, with equity and 35 days of paid time off.
This recap is dataskew's editorial summary, not the company's copy.