Physical Intelligence7 дней назад
ML Infra Engineer (Data Systems)
Зарплата не указана
Полная занятостьОфис
Обязанности
- 01Data Ingestion & Processing: Design and build high-throughput pipelines that validate, transform, and featurize raw multimodal data
- 02Batch & Streaming Systems: Operate large-scale batch and streaming workflows over massive datasets
- 03Storage Systems: Design object storage layouts, metadata systems, and efficient access patterns; choose file formats with performance and scalability in mind
- 04Data Lifecycle Management: Build systems for backfills, dataset rebuilds, garbage collection, and large-scale transformations
- 05Training-Time Performance: Optimize dataloaders, sharding, prefetching, caching, and throughput to reduce time from data arrival → model training
- 06Metadata & Indexing: Build scalable metadata stores for datasets, annotations, and training artifacts
- 07Data Movement: Move petabytes efficiently across clusters and environments
- 08Operational Correctness: Implement observability, validation, and guardrails to prevent silent data regressions
- 09Cross-Functional Collaboration: Work closely with cross-functional teams of researchers, engineers and roboticists to translate evolving data needs into robust systems
Требования
- 01Strong software engineering fundamentals
- 02Experience building distributed systems or large-scale data pipelines
- 03Comfort reasoning about performance, memory, I/O, and storage efficiency
- 04Familiarity with batch and/or streaming processing systems
- 05Experience with object storage systems and data format tradeoffs
- 06Ownership mindset: design, build, operate, and iterate on systems end-to-end
- 07Enjoy working closely with researchers and unblocking fast-moving projects
Условия
- 01Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records