OpenAI4 days ago

Software Engineer, Trainium

Salary not specified
MARKET
15,900median for this role
Data Scientist · 115 jobs with disclosed pay
5,000half of the offers: 12,796–20,50043,793
The employer didn't disclose pay — compare with the market yourself.
Полная занятостьУдалёнка

Responsibilities

  • 01Build and optimize OpenAI's inference stack for AWS Trainium
  • 02Develop high-performance kernels for critical model operations and workloads
  • 03Extend and improve compiler support to efficiently target Trainium hardware
  • 04Build the systems necessary to execute and optimize the model forward pass on Trainium
  • 05Profile workloads and identify bottlenecks across kernels, compiler-generated code, runtime, and model execution
  • 06Partner with inference and ML systems teams to bring new models and architectures onto Trainium
  • 07Work across the hardware/software boundary to unlock performance and capabilities from specialized AI accelerators
  • 08Own complex performance and systems problems end-to-end, from investigation through production deployment

Requirements

  • 013+ years of relevant engineering experience, ideally in ML systems, compilers, kernels, runtimes, or performance engineering
  • 02Strong systems programming fundamentals and experience writing performance-critical software
  • 03Experience working with GPU, TPU, Trainium, or other specialized accelerator architectures
  • 04Ability to reason about performance across multiple layers of the stack, from hardware and kernels through compilers and ML frameworks
  • 05Owning technically ambiguous problems end-to-end and learning new hardware and software domains as needed