Scale AIНовая9 часов назад

Frontier Agents Engineer (Applied AI)

Зарплата не указана
San Francisco

Навыки

PythonLLMsOpenAIClaudeMCPvector databasesretrieval systemsmachine learningRAGsemantic searchknowledge graphsfine-tuningdistillationreinforcement learning

Обязанности

  • 01Design and deploy production AI agents leveraging large language models, reasoning, retrieval, memory, and tool use
  • 02Architect intelligent systems combining LLMs, traditional machine learning, structured knowledge, enterprise data, and deterministic software
  • 03Engineer customer intelligence layers, retrieval pipelines, memory systems, and knowledge representations for agents to reason over enterprise data
  • 04Develop multi-agent systems coordinating reasoning, planning, tool execution, and human oversight
  • 05Translate frontier AI research into production systems by evaluating new models, prompting techniques, reasoning paradigms, and agent architectures
  • 06Own the full experimentation lifecycle from hypothesis generation to production rollout
  • 07Design rigorous evaluation frameworks using offline benchmarks, online A/B experiments, golden datasets, regression suites, LLM-as-a-Judge, and human evaluation
  • 08Run controlled experiments and ablation studies to understand contributions of different models, prompts, retrieval strategies, and architectures
  • 09Continuously evaluate newly released frontier models for improvements in quality, latency, reliability, or cost
  • 10Build production-quality AI systems with emphasis on reliability, observability, latency, safety, and cost
  • 11Design agent guardrails, fallback strategies, tracing, monitoring, and evaluation pipelines for safe deployment
  • 12Collaborate with infrastructure engineers to deploy AI systems securely within enterprise cloud environments
  • 13Build human-in-the-loop workflows combining AI automation with expert oversight
  • 14Partner directly with enterprise customers to understand business, data, and operational challenges
  • 15Translate ambiguous customer problems into production AI architectures
  • 16Rapidly prototype new ideas, validate with customers, and evolve solutions into scalable production systems
  • 17Identify reusable patterns that become core capabilities across enterprise deployments

Требования

  • 014+ years of software engineering, machine learning, or applied AI experience
  • 02Strong Python programming skills
  • 03Experience building production AI systems using LLMs
  • 04Experience with modern AI tooling including OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval systems
  • 05Strong understanding of machine learning fundamentals and modern language models
  • 06Experience designing or evaluating AI systems using quantitative metrics
  • 07Excellent communication skills and ability to work directly with enterprise customers