Anthropic6 days ago

Staff + Senior Software Engineer, Inference

Salary not specified
MARKET
15,900median for this role
Data Scientist · 115 jobs with disclosed pay
5,000half of the offers: 12,796–20,50043,793
The employer didn't disclose pay — compare with the market yourself.
Ontario

Responsibilities

  • 01Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
  • 02Develop resilient, flexible systems that adapt in real time to real world events
  • 03Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
  • 04Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
  • 05Build and operate production-grade deployment pipelines for releasing new models to users
  • 06Provide high-performance inference infrastructure that enables researchers to develop next-generation models
  • 07Integrate new AI accelerator platforms and support inference for new model architectures

Requirements

  • 01Significant software engineering experience, particularly with distributed systems
  • 02Results-oriented, with a bias towards flexibility and impact
  • 03Willingness to pick up slack, even if it goes outside your job description
  • 04Desire to learn more about machine learning systems and infrastructure
  • 05Thrive in environments where technical excellence directly drives both business results and research breakthroughs
  • 06Care about the societal impacts of your work
  • 07Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience
  • 08Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

What we offer

  • 01Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time
  • 02Visa sponsorship: We do sponsor visas
  • 03Applications will be reviewed on a rolling basis