Harvey10 дней назад
Engineering Manager, Model Infrastructure
Зарплата не указана
Полная занятостьУдалёнка
Обязанности
- 01Lead and grow a high-performing team of software engineers responsible for Harvey's Model Infrastructure platform
- 02Define the technical roadmap for model reliability, scalability, and operational excellence
- 03Build highly reliable systems for model provisioning, capacity management, failover, and incident response across multiple AI providers
- 04Own Harvey's multi-provider model platform, including provider integrations, SDK upgrades, API migrations, and onboarding new model providers
- 05Drive the evolution of our Unified Model Controller (UMC) and Model Selector platform to automatically detect degraded models and intelligently route traffic based on health, latency, quality, compliance, and cost
- 06Improve observability through health dashboards, alerting, token usage analytics, cost reporting, and end-to-end model telemetry
- 07Partner with Product Engineering to support new model launches, capacity planning, experimentation, and proactive production monitoring
- 08Lead initiatives to improve inference efficiency, reduce infrastructure costs, and increase model utilization across providers
- 09Build the infrastructure foundation for Harvey's future model training efforts, including data pipelines, model operations, training environments, and AI platform capabilities
- 10Partner with executive leadership on long-term AI infrastructure strategy and vendor relationships
- 11Recruit, mentor, and develop exceptional engineering talent while fostering a culture of technical excellence and operational ownership
Требования
- 018+ years of software engineering experience, including multiple years managing high-performing engineering teams
- 02Experience leading teams responsible for large-scale distributed systems or cloud infrastructure
- 03Strong technical background that enables you to guide architectural decisions and mentor senior engineers
- 04Experience operating highly available production services with strong reliability and operational excellence
- 05Experience building platforms that require scalability, observability, automation, and cost optimization
- 06Strong cross-functional leadership skills with the ability to partner effectively across Engineering, Research, Product, and external vendors
- 07Excellent communication skills and the ability to influence technical strategy across organizations
- 08A passion for building teams and developing engineering talent
Условия
- 01$260,000 - $340,000 USD