LangChain9 days ago

Research Engineer, LangSmith Engine

Salary not specified
MARKET
16,167median for this role
Data Scientist · 79 jobs with disclosed pay
5,800half of the offers: 13,333–20,88843,793
The employer didn't disclose pay — compare with the market yourself.
Полная занятостьОфис

Responsibilities

  • 01Build and maintain benchmarks and evaluations that measure the quality and efficiency of Engine agents on real-world tasks
  • 02Design and run experiments to improve agent performance across models, prompting, context, tools, orchestration, and agent strategies
  • 03Explore and implement post-training and fine-tuning techniques when they can meaningfully improve agent capabilities, quality, or cost
  • 04Turn successful experiments into production improvements, working closely with engineers and researchers to measure impact and prevent regressions
  • 05Help define the ML roadmap and technical direction for improving Engine agents, and mentor other engineers through strong technical leadership

Requirements

  • 014+ years of experience in ML/AI research, or a closely related field
  • 02Master’s or Ph.D. in a relevant scientific field
  • 03Hands-on experience working with LLMs and AI agents, including analyzing model behavior and improving real-world performance
  • 04Strong experience designing benchmarks, evaluations, and experiments for AI/ML systems; you know how to tell whether a change actually made an agent better
  • 05Strong software engineering skills, with a track record of taking ideas from research prototype to measurable production impact
  • 06You have maximum agency and strong research judgment: you can identify high-impact problems, work through ambiguity, move quickly, and communicate your findings clearly

What we offer

  • 01Location: SF and NYC
  • 02Competitive compensation including base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks
  • 03Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, and life insurance
  • 04Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations
  • 05Meals on in-office days in the US