Together AI1 день назад
Research Engineer, Large-Scale Training
Зарплата не указана
San Francisco
Обязанности
- 01Design, implement, and optimize core components of Together's large-scale training infrastructure
- 02Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads
- 03Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication
- 04Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods
- 05Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases
- 06Rapidly enable support for newly released open-source foundation models on the Together platform
- 07Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability
Требования
- 01Demonstrated ability to independently take ambiguous performance or infrastructure problems from investigation through deployment
- 02Strong programming skills in Python and PyTorch, with an emphasis on writing efficient, maintainable code
- 03Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node environments
- 04Solid understanding of ML systems fundamentals, including GPU architecture, mixed-precision training, and distributed training paradigms such as data, tensor, pipeline, or expert parallelism
- 05Strong communication skills and the ability to collaborate effectively with both researchers and engineers
- 06Passion for staying current with advances in AI research and applying them to real-world systems
- 07Excitement about translating cutting-edge research into production systems that deliver customer impact
Условия
- 01Competitive compensation, startup equity, health insurance, and other benefits
- 02The US base salary range for this full-time position is $200,000 - $290,000
- 03Salary ranges are determined by location, level and role