Poolside17.04.2026

Member of Engineering (Evaluations)

Полная занятостьУдалёнка

Обязанности

  • 01Research and implementation of evaluations and benchmarks for base models and instruction following models
  • 02Collaborate with applied research and product teams to define meaningful metrics and evaluations that capture progress on real world software development skills
  • 03Work in a team: plan future steps, discuss, and communicate clearly with peers

Требования

  • 01Experience with Large Language Models (LLM)
  • 02Strong understanding and intuition of LLMs, and their limitations
  • 03Good taste, and a curious mindset
  • 04Strong engineering background
  • 05Strong programming skills, ideally across multiple languages
  • 06Familiar with full software development life cycle
  • 07Programming experience
  • 08Linux
  • 09Strong algorithmic skills
  • 10Multiple languages, including Python
  • 11Use modern tools and are always looking to improve
  • 12Strong critical thinking and ability to question code quality policies when applicable

Условия

  • 01Fully remote work & flexible hours
  • 0237 days/year of vacation & holidays
  • 03Health insurance allowance for you and dependents
  • 04Company-provided equipment
  • 05Wellbeing, always-be-learning and home office allowances
  • 06Frequent team get togethers
  • 07Great diverse & inclusive people-first culture