Member of Technical Staff, Agents
Clera
Key skills
- Python
- Machine Learning
- SQL
About the Role
Join a small, senior team building autonomous AI assistants for executive workflows. You will develop agent capabilities and evaluation systems that help ensure real-world tasks are completed reliably, with measurable quality.
What You'll Do
- Build agents that complete delegated work end to end for real users.
- Define reliable measures of success for agent tasks and maintain representative evaluations.
- Develop new agent capabilities and validate them before they reach users.
- Investigate production failures and deliver fixes that address underlying causes.
- Build systems to detect known failure patterns and emerging issues at scale.
- Improve agent recovery when tools or websites fail.
- Create repeatable methods for engineers to measure the impact of agent changes.
What We're Looking For
- At least 3 years of data science or machine learning experience building evaluation systems, metrics, or quality measurement for products.
- Production-quality Python and SQL skills, including experience analyzing large datasets and building automated pipelines.
- Experience designing evaluation frameworks, datasets, measurable criteria, and appropriate metrics.
- A track record delivering production AI, machine learning, agent, or agent-evaluation systems for real users.
- Experience improving agent reliability, owning systems end to end, and measuring results in production.
- Familiarity with statistics, experiment design, and realistic end-to-end simulations; experience with fine-tuning, post-training, or reinforcement learning is valuable.
- Experience with Python, Django, React, and TypeScript; familiarity with evaluation tools such as Braintrust or Raindrop is useful.
- Demonstrated progression and sustained experience in a role, with the ability to work through ambiguity and ship quickly.
Compensation & Benefits
Base salary is $200,000 to $300,000 USD annually. Visa sponsorship is not available.
Location
On-site in Palo Alto, California, with four days a week in the office.
Originally posted on Himalayas
Similar jobs
SQL & Analytics Engineer Expert
$60–$100/hr
Remote · via AfterQuery
RemoteContractData Analysis- SQL
ML Engineer (MSc. or PhD)
$60–$120/hr
Global · via micro1
RemoteContractSoftware Engineering- Scientific Research
- Python
- Machine Learning
India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico · via Turing
RemoteContractSoftware Engineering- Machine Learning
- Python
- Statistics
Stripe · US
On-siteFull-timeSales- SQL
- Python
- Scala
Almetra · Onsite Berlin · via Arbeitnow
On-siteFull-timeSoftware Engineering- Machine Learning
- Deep Learning
- Python
Causa Prima · Munich · via Arbeitnow
On-siteFull-timeOther Engineering- LLMs
- SQL
- Python
Remote · via Turing
RemoteContractSoftware Engineering- Software Engineering
- Python
- SQL
India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico · via Turing
RemoteContractWriting- Python
- Technical Writing
- Software Engineering
Addepto · Remote · via Remote OK
RemoteFull-timeData Analysis- Python
- SQL
- Data Visualization
Toptal · Remote — Anywhere in the World · via Remote OK
RemoteFull-timeSoftware Engineering- Python
- SQL
- Docker
Software Engineer
$10,000–$30,000/yr
Claims · Remote · via Remote OK
RemoteFull-timeSoftware Engineering- Python
- Web Development
- SQL
Ostrom · Remote · via Arbeitnow
RemoteFull-timeOther Engineering- Python
- Fluent German
- SQL
Bjak · Germany · via Arbeitnow
On-siteFull-timeSoftware Engineering- Machine Learning
- Python
- PyTorch
Sr. Engineer - Automation
$100,561–$145,814/yr
Blattner · Remote — United States · via Himalayas
RemoteFull-timeOther Engineering- LLMs
- Python
- SQL

