Scale AI19 days ago
Senior AI Product Manager, Leaderboard
Salary not specified
MARKET
15,900 ₽median for this role
Data Scientist · 115 jobs with disclosed pay
5,000half of the offers: 12,796–20,50043,793
The employer didn't disclose pay — compare with the market yourself.
New York
Responsibilities
- 01Own the roadmap and strategy for Scale’s SEAL Leaderboard portfolio
- 02Facilitate the Leaderboard Steering Committee and drive alignment across stakeholders
- 03Evaluate, prioritize, and operationalize new leaderboard proposals
- 04Define and manage the end-to-end leaderboard product lifecycle
- 05Partner with ML researchers and domain experts to develop trustworthy evaluation methodologies
- 06Drive the roadmap for leaderboard infrastructure, automation, and operational tooling
- 07Establish governance processes for benchmark quality, evaluation integrity, and release management
- 08Work directly with frontier AI labs and enterprise customers to understand evaluation needs
- 09Track adoption, usage, customer impact, and business outcomes
- 10Identify new evaluation categories, benchmark opportunities, and leaderboard products
- 11Collaborate closely with GTM teams to support customer engagements and strategic partnerships
Requirements
- 015+ years of experience in product management, technical program management, consulting, or customer-facing technical roles
- 02Strong technical fluency, including familiarity with machine learning systems, AI model evaluation, benchmarking, or data products
- 03Experience building and scaling products that require coordination across engineering, operations, and business teams
- 04Excellent stakeholder management and executive communication skills
- 05Strong analytical skills and the ability to translate ambiguous market signals into clear product strategy
- 06Experience working with AI researchers, ML teams, or evaluation frameworks is strongly preferred
- 07Entrepreneurial mindset with a track record of creating new products or initiatives from the ground up
- 08Bias for action and comfort operating in fast-moving, ambiguous environments
- 09Passion for advancing trustworthy AI evaluation and helping define industry standards
What we offer
- 01Base salary range for San Francisco, New York, Seattle: $205,600 — $257,000 USD
- 02Compensation includes base salary, equity, and benefits
- 03Benefits include comprehensive health, dental and vision coverage
- 04Benefits include retirement benefits
- 05Benefits include a learning and development stipend
- 06Benefits include generous PTO
- 07Role may be eligible for additional benefits such as a commuter stipend