Anthropic9 дней назад
Evals Infrastructure Tech Lead / Manager
Зарплата не указана
San Francisco
Обязанности
- 01Lead the team building the distributed systems that schedule, orchestrate, and execute evals for our frontier model training
- 02Own eval throughput and cost: compute allocation across suites, queueing against constrained accelerator pools, caching and reuse of eval work
- 03Build and scale the harnesses researchers use to define, run, and iterate on evals
- 04Make eval results trustworthy — determinism, reproducibility, and honest uncertainty quantification on reported metrics
- 05Ensure eval signal reaches the dashboards and reviews where launch decisions actually get made
- 06Contribute directly as an engineer while managing and growing the team, prioritizing its work, and coaching your reports
Требования
- 01Have led technical projects end-to-end on large-scale distributed systems
- 02Have 1+ years managing engineers (or tech-lead-with-reports experience)
- 03Are strong in Python and Rust
- 04Have built high-throughput, fault-tolerant systems on cloud or on-prem accelerator fleets
- 05Care about measurement quality, not just pipeline uptime
- 06Communicate well with researchers and can translate research needs into infrastructure
- 07Are deeply interested in the transformative effects of advanced AI and committed to safe development
- 08Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
- 09Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Условия
- 01Annual Salary: $500,000 — $850,000 USD
- 02Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time
- 03Visa sponsorship: We do sponsor visas