Scale AIНовая9 часов назад
Frontier Agents Engineer (Applied AI)
Зарплата не указана
San Francisco
Навыки
PythonLLMsOpenAIClaudeMCPvector databasesretrieval systemsmachine learningRAGsemantic searchknowledge graphsfine-tuningdistillationreinforcement learning
Обязанности
- 01Design and deploy production AI agents leveraging large language models, reasoning, retrieval, memory, and tool use
- 02Architect intelligent systems combining LLMs, traditional machine learning, structured knowledge, enterprise data, and deterministic software
- 03Engineer customer intelligence layers, retrieval pipelines, memory systems, and knowledge representations for agents to reason over enterprise data
- 04Develop multi-agent systems coordinating reasoning, planning, tool execution, and human oversight
- 05Translate frontier AI research into production systems by evaluating new models, prompting techniques, reasoning paradigms, and agent architectures
- 06Own the full experimentation lifecycle from hypothesis generation to production rollout
- 07Design rigorous evaluation frameworks using offline benchmarks, online A/B experiments, golden datasets, regression suites, LLM-as-a-Judge, and human evaluation
- 08Run controlled experiments and ablation studies to understand contributions of different models, prompts, retrieval strategies, and architectures
- 09Continuously evaluate newly released frontier models for improvements in quality, latency, reliability, or cost
- 10Build production-quality AI systems with emphasis on reliability, observability, latency, safety, and cost
- 11Design agent guardrails, fallback strategies, tracing, monitoring, and evaluation pipelines for safe deployment
- 12Collaborate with infrastructure engineers to deploy AI systems securely within enterprise cloud environments
- 13Build human-in-the-loop workflows combining AI automation with expert oversight
- 14Partner directly with enterprise customers to understand business, data, and operational challenges
- 15Translate ambiguous customer problems into production AI architectures
- 16Rapidly prototype new ideas, validate with customers, and evolve solutions into scalable production systems
- 17Identify reusable patterns that become core capabilities across enterprise deployments
Требования
- 014+ years of software engineering, machine learning, or applied AI experience
- 02Strong Python programming skills
- 03Experience building production AI systems using LLMs
- 04Experience with modern AI tooling including OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval systems
- 05Strong understanding of machine learning fundamentals and modern language models
- 06Experience designing or evaluating AI systems using quantitative metrics
- 07Excellent communication skills and ability to work directly with enterprise customers