OpenAI7 дней назад
Applied AI Software Engineer, GTM Growth Engineering
Зарплата не указана
Полная занятостьSan Francisco
Обязанности
- 01Own the production improvement loop across agent behavior, customer and operator feedback, evaluation, experimentation, and verified business outcomes
- 02Instrument agent workflows so model interactions, tool use, decisions, failures, human edits, and downstream outcomes can be understood in context
- 03Define meaningful quality standards, representative evaluation datasets, regression coverage, and production monitoring for real GTM workflows
- 04Investigate why agents underperform across context, knowledge, instructions, tools, routing, guardrails, or workflow design
- 05Design and ship targeted behavior improvements, including changes to prompting, context construction, decision logic, tool use, and human-review paths
- 06Build backend services, APIs, data models, and feedback pipelines that make agent behavior observable, steerable, and reproducible
- 07Run controlled experiments, production replays, or staged rollouts to measure whether changes improve quality and downstream business results
- 08Partner with Product, Data Science, Sales, and B2B Marketing to prioritize high-value problems and define customer and business success
- 09Ship with appropriate safeguards for privacy, security, reliability, human oversight, and safe operational rollout
Требования
- 014+ years of software, backend, applied AI, or product-engineering experience building reliable production systems
- 02Experience building AI agents, LLM-powered applications, or other model-driven workflows that operated on real production traffic
- 03Experience diagnosing and improving agent behavior using production traces, user feedback, evaluation, experimentation, or careful systems design
- 04Practical experience with evaluation design, regression testing, human or model grading, online quality signals, or controlled experiments
- 05Strong backend engineering skills across Python, APIs, data pipelines, stateful workflows, and production services
- 06Strong product judgment and the ability to connect technical changes to customer experience, conversion, qualified pipeline, or operational efficiency
- 07Comfort working across model behavior, context, knowledge, tools, workflow state, and human-in-the-loop decisions
- 08The ability to work closely with technical and non-technical partners across Engineering, Product, Data Science, Sales, and B2B Marketing
- 09A pragmatic mindset: you can scope ambiguous problems, ship useful improvements, and build toward a durable system