Scale AIНовая9 часов назад
Senior Frontier Agents Engineer (Applied AI)
Зарплата не указана
San Francisco
Навыки
PythonLLMsOpenAIClaudeMCPagent frameworksvector databasesretrieval systemsRAGsemantic searchknowledge graphscustomer intelligence systemsstructured knowledge representationsfine-tuningdistillationreinforcement learning
Обязанности
- 01Design and deploy production AI agents leveraging the latest advances in large language models, reasoning, retrieval, memory, and tool use
- 02Architect intelligent systems that combine LLMs, traditional machine learning, structured knowledge, enterprise data, and deterministic software into reliable production workflows
- 03Engineer customer intelligence layers, retrieval pipelines, memory systems, and knowledge representations for reasoning over large, heterogeneous enterprise data
- 04Develop multi-agent systems that coordinate reasoning, planning, tool execution, and human oversight
- 05Translate frontier AI research into production systems by rapidly evaluating new models, prompting techniques, reasoning paradigms, and agent architectures
- 06Own the full experimentation lifecycle, from hypothesis generation to production rollout
- 07Design rigorous evaluation frameworks using offline benchmarks, online A/B experiments, golden datasets, regression suites, LLM-as-a-Judge, and human evaluation
- 08Run controlled experiments and ablation studies to understand the contribution of different models, prompts, retrieval strategies, reasoning techniques, memory systems, and agent architectures
- 09Continuously evaluate newly released frontier models
- 10Develop confidence estimation, reflection, and continuous learning systems that improve agents over time using real-world feedback
- 11Build production-quality AI systems with a strong emphasis on reliability, observability, latency, safety, and cost
- 12Design agent guardrails, fallback strategies, tracing, monitoring, and evaluation pipelines for safe deployment in high-stakes environments
- 13Collaborate with infrastructure engineers to deploy AI systems securely within enterprise cloud environments
- 14Build human-in-the-loop workflows that effectively combine AI automation with expert oversight
- 15Partner directly with enterprise customers to understand their business, data, and operational challenges
- 16Translate ambiguous customer problems into production AI architectures
- 17Rapidly prototype new ideas, validate them with customers, and evolve successful solutions into scalable production systems
- 18Identify reusable patterns that become core capabilities across many enterprise deployments
Требования
- 015+ years of software engineering, machine learning, or applied AI experience
- 02Strong Python programming skills
- 03Experience building production AI systems using LLMs
- 04Experience with modern AI tooling, including OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval systems
- 05Strong understanding of machine learning fundamentals and modern language models
- 06Experience designing or evaluating AI systems using quantitative metrics
- 07Excellent communication skills and the ability to work directly with enterprise customers