Baseten02.06.2026
Software Engineer- BIS (Baseten Inference Stack)
Полная занятостьУдалёнка
Обязанности
- 01Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference
- 02Work across the stack, from customer-facing features to low-level infrastructure components
- 03Build platform capabilities related to routing, autoscaling, scheduling, observability, and runtime management
- 04Improve the reliability, scalability, and usability of our inference stack
- 05Collaborate closely with Model Performance engineers to make new inference optimizations broadly available to customers and easy to configure
- 06Help define best practices around testing, release automation, benchmarking, and operational excellence
- 07Debug complex production systems spanning Kubernetes, distributed runtimes, networking, and GPU workloads
- 08Make thoughtful engineering tradeoffs balancing performance, reliability, operational simplicity, and developer experience
- 09Own projects end-to-end: from architecture and implementation through deployment, monitoring, and iteration based on customer feedback
Требования
- 01Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field
- 02Strong background in distributed systems, backend infrastructure, or platform engineering
- 03Experience building and operating production systems where reliability, latency, and scale are first-class concerns
- 04Strong sense of developer experience: you think about how systems are used, not just how they work
- 05Motivated and willing to learn new languages, frameworks, and systems as needed
- 06Ability to debug complex systems across multiple layers of the stack
- 07Genuine interest in inference engineering. You don't need to have hands on experience but are willing to learn
- 08Excellent communication and collaboration skills
Условия
- 01Competitive compensation, including meaningful equity.
- 02100% coverage of medical, dental, and vision insurance for employee and dependents
- 03Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- 04Paid parental leave
- 05Fertility and family-building stipend through Carrot
- 06Company-facilitated 401(k)
- 07Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.