Skip to content
Remotejobify
Match me Alerts
Back to jobs

Member of Technical Staff, Agents

At Clera · Palo Alto; Palo Alto, California, United States

Salary: US$200,000–300,000 a year

Early applicant Posted 14 hours ago. Radar emails jobs like this within hours of us finding them. The free weekly email can take up to a week.

Apply on Clera (opens in a new tab)

See how well you match Match me reads your CV and picks the jobs that suit you best.

Get jobs like this within hours Radar emails you new jobs open to you within hours of us finding them, before most people see them.

Where you can work from

Open to the United States

“Palo Alto”

From the location.

“Palo Alto, California, United States”

From the job board field.

Report a mistake

Posted
14 hours ago
First seen by us
9 November 2026
Last checked
7 hours ago

Job description

From Clera’s job post, as they wrote it.

About the Role

Join a small, senior team building autonomous AI assistants for executive workflows. You will develop agent capabilities and evaluation systems that help ensure real-world tasks are completed reliably, with measurable quality.

What You'll Do

* Build agents that complete delegated work end to end for real users.

* Define reliable measures of success for agent tasks and maintain representative evaluations.

Read the full description

* Develop new agent capabilities and validate them before they reach users.

* Investigate production failures and deliver fixes that address underlying causes.

* Build systems to detect known failure patterns and emerging issues at scale.

* Improve agent recovery when tools or websites fail.

* Create repeatable methods for engineers to measure the impact of agent changes.

What We're Looking For

* At least 3 years of data science or machine learning experience building evaluation systems, metrics, or quality measurement for products.

* Production-quality Python and SQL skills, including experience analyzing large datasets and building automated pipelines.

* Experience designing evaluation frameworks, datasets, measurable criteria, and appropriate metrics.

* A track record delivering production AI, machine learning, agent, or agent-evaluation systems for real users.

* Experience improving agent reliability, owning systems end to end, and measuring results in production.

* Familiarity with statistics, experiment design, and realistic end-to-end simulations; experience with fine-tuning, post-training, or reinforcement learning is valuable.

* Experience with Python, Django, React, and TypeScript; familiarity with evaluation tools such as Braintrust or Raindrop is useful.

* Demonstrated progression and sustained experience in a role, with the ability to work through ambiguity and ship quickly.

Compensation & Benefits

Base salary is $200,000 to $300,000 USD annually. Visa sponsorship is not available.

Location

On-site in Palo Alto, California, with four days a week in the office.

Apply on Clera (opens in a new tab)

Get jobs like this by email

Once a week, we email the new remote jobs open where you live, each with the line that proves it. Every email has a one-click unsubscribe.

More remote jobs