Perplexity4 дня назад
Member of Technical Staff (Search Quality Analyst)
Зарплата не указана
РЫНОК
12 083 ₽медиана по профессии
System Analyst · 27 вакансий с указанной зарплатой
5 680половина предложений: 9 403–15 33468 087
Работодатель не указал зарплату — сравните с рынком сами.
Полная занятостьУдалёнка
Обязанности
- 01Find and diagnose quality issues in our search pipeline
- 02Design metrics from scratch to track and measure search quality
- 03Build datasets for model training, including LLM-as-a-judge labeling pipelines
- 04Improve search snippet quality and page selection algorithms for indexing
- 05Design and analyze A/B experiments to validate improvements
Требования
- 014+ years of experience as a data analyst or in a related role
- 02Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
- 03Proficiency with SQL and Python
- 04Demonstrated hands-on experience with at least one of the following: Designing metrics from scratch (not just analyzing existing A/B experiments)
- 05Building labeling pipelines using LLM-as-a-judge
- 06Training ML models that shipped to production with measurable metric improvements
- 07Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals
Условия
- 01Hybrid work in Belgrade, London or Berlin