Cohere13.01.2026
Staff Software Engineer, Inference Infrastructure
Зарплата не указана
Полная занятостьУдалёнка
Обязанности
- 01Developing, deploying, and operating the AI platform delivering Cohere's large language models through API endpoints
- 02Working closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments
- 03Interfacing with customers and creating customized deployments to meet their specific needs
Требования
- 015+ years of engineering experience running production infrastructure at a large scale
- 02Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- 03Experience with Kubernetes dev and production coding and support
- 04Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- 05Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- 06Experience in compute/storage/network resource and cost management
- 07Excellent collaboration and troubleshooting skills to build mission-critical systems
- 08The grit and adaptability to solve complex technical challenges that evolve day to day
- 09Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators)
- 10Strong understanding or working experience with distributed systems
- 11Experience in Golang, C++ or other languages designed for high-performance scalable servers
Условия
- 01Weekly lunch stipend of $75/£75 or equivalent
- 02Full health and dental benefits including mental health budget
- 03RRSP matching, 401K, Pension Scheme
- 04100% Parental Leave top-up for up to 6 months
- 05Annual enrichment benefits for arts & culture, fitness/wellness, quality time
- 06Workspace improvement credit
- 07Education & learning stipend for conferences, courses, and coaching
- 086 weeks of paid vacation (30 working days)
- 09Budget for traveling to other offices if remote
- 10Annual company offsite
- 11Remote-friendly work environment
- 12Daily lunch program and snacks for office employees
- 13Co-working benefit for remote employees
- 14$500 home office stipend