Mercor9 дней назад
Research Operations, Code
Зарплата не указана
Полная занятостьОфис
Обязанности
- 01Decompose frontier model capabilities and translate weaknesses into data solutions
- 02Design data production pipelines including human-expert workflows and synthetic generation
- 03Drive execution through expert contributors under demanding timelines
- 04Build deep relationships with lab researchers as primary point of contact
- 05Develop understanding of customer models' capabilities and gaps
- 06Evaluate model outputs and create targeted loss analysis
- 07Translate research goals into concrete task designs and quality specifications
- 08Prototype new generation and validation approaches
- 09Manage end-to-end data pipelines from specification to delivery
- 10Diagnose bottlenecks and implement workflow solutions
- 11Run daily internal syncs to stay ahead of issues
- 12Design human-expert labeling and evaluation flows
- 13Source, vet, train and manage teams of domain experts
Требования
- 01Technical judgment with coding literacy and ML/Model Benchmark familiarity
- 02Ability to evaluate model outputs and reason about frontier-model capabilities
- 03Track record of running complex, high-stakes projects end to end
- 04Strong analytical and communication skills
- 05Comfort owning high-profile relationships with technical customers
Условия
- 01Work in-person five days a week in San Francisco, NYC, or London offices
- 02Startup intensity with occasional weekend responsiveness
- 03Performance incentives and high-slope career trajectory
- 04Meaningful equity
- 05Research Ops team members generate $10M+ in project revenue annually