ElevenLabs9 дней назад

Research Engineer - Web Crawlers

Зарплата не указана
РЫНОК
26 250медиана по профессии
AI Researcher · 36 вакансий с указанной зарплатой
5 600половина предложений: 16 785–65 900143 300
Работодатель не указал зарплату — сравните с рынком сами.
Полная занятостьУдалёнка

Обязанности

  • 01Building and operating large-scale, distributed web crawlers that discover, fetch, and extract data across billions of pages reliably and efficiently.
  • 02Solving hard crawling problems such as content extraction from messy HTML, deduplication at web scale, freshness and recrawl strategies, and politeness and rate-limit handling.
  • 03Designing targeted crawling pipelines that find high-value data sources, including audio, video, and multilingual content, and turn them into clean training-ready datasets.
  • 04Creating tooling and infrastructure that lets researchers request, monitor, and explore newly crawled web data quickly and reliably.

Требования

  • 01Hands-on experience building and scaling web crawlers or scraping systems, ideally in support of machine learning training data.
  • 02Strong engineering skills in distributed systems at scale (e.g., Kubernetes, queue-based architectures, or custom pipelines processing billions of documents).
  • 03The capacity to autonomously evaluate the quality, coverage, and compliance of crawled data, and to build the tooling to measure it.

Условия

  • 01Innovative culture with opportunity to shape AI trajectory.
  • 02Growth paths for impact beyond immediate role.
  • 03Annual discretionary stipend for learning & development.
  • 04Annual discretionary stipend for social travel to meet colleagues.
  • 05Annual company offsite in varying locations.
  • 06Monthly co-working stipend if not near main hubs.
  • 07Fully remote role, executable globally.
  • 08Option to work from offices in London, New York, San Francisco, Warsaw.