All engineering roles
Open engineering roles from public job boards. Postings that mention AI tools come first.
309 postings
Elastic · United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
Perplexity · Belgrade; London; Berlin (Serbia)
…- Training ML models that shipped to production with measurable metric improvements - Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals Nice to…
Flex Capital Management GmbH · Berlin
…relationalen und NoSQL-Datenbanken und setzt selbstständig nachhaltige Datenmodelle auf. Du kennst LLM-APIs (OpenAI, Claude) aus der Praxis und weißt, wie man daraus hochwertigen Output bekommt (Evals). Du hast bereits…
Anthropic · Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA; San Francisco, California, United States
StaffRemoteAgentic workflowsEvals / LLM evaluationMCP (Model Context Protocol)Prompt / context engineering…from first prototype through production operation. You'll combine full-stack engineering (MCP servers, agentic systems, web applications, etc.) with hands-on evaluation work (behavior benchmarks, production monitoring, ROI…
Replit · Foster City, CA; NYC (SoHo) (USA)
…and technical environments - Hands-on work with LLM applications in production: retrieval, tool calls, and evals. - Experience designing and owning complex technical systems from architecture through production -…
Proxima Fusion · Munich (Germany)
DevOps / SRE / PlatformGermanyAgentic workflowsMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)AI security…are possible in Europe when you assemble the best talent. YOUR IMPACT - Technical owner of Proxima’s AI agent platform, turning autonomous agents into reliable everyday colleagues for physicists and engineers. - Own…
Notion · San Francisco, California; New York, New York (United States)
…strengths, areas of interest, and career development goals - Familiarity with AI/agent tooling, evals, or LLM-driven product experiences Notion is committed to providing highly competitive cash compensation,…
Workwize · Amsterdam ; Amsterdam
…Someone who cares more about what ships than about how many lines they wrote to ship it. You have used AI / AI agents as your default way of working to build and launch things at a pace that surprises people. You don't need a…
Elyos · London (United Kingdom)
Data / ML engineeringUnited KingdomAgentic workflowsEvals / LLM evaluationRAGPrompt / context engineeringFine-tuning / LoRA / PEFT…what's needed. - Hands-on experience building with LLMs in production - prompting, tool calling, RAG, or agentic workflows - and shipping AI products end-to-end (at a startup, on a side project, in open source, or at scale in a…
Anthropic · San Francisco, CA | New York City, NY; San Francisco, California, United States
…error recovery — and reworking all of it with every model release — Managed Agents pairs an Anthropic-built agent harness with production infrastructure for sessions, environments, tools, memory, and permissions, exposed through a…
Legora · Stockholm HQ (Sweden)
…document upload, processing, retrieval, citations, and long-context reasoning - Design and evaluate agentic workflows, retrieval strategies, and LLM-powered product experiences that can handle real legal work at scale - Work…
Callosum · London (United Kingdom)
…team is developing the science that makes that possible: a principled, evidence-based method for building agentic systems automatically at unprecedented scale. The team tackles these problems on two fronts. We build the tools to…
Cohere · London; Europe; Toronto (United Kingdom)
…product quality. You should be excited by the craft of building careful evals: evals that capture messy agentic workflows, reflect actual customer needs, resist superficial benchmark hacking, and provide useful signal for where the…
Snowflake · US-CA-Menlo Park (United States)
…Define the long-term technical vision for Snowflake Intelligence. Lead the architectural design of multi-agent systems, complex tool-use frameworks, and self-correcting NL-to-SQL engines. - Drive Industry-Leading…
Cohere · London (United Kingdom)
…London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Role Overview: Building AI agents that can assist with any kind of enterprise work is a challenging, open-ended problem. One key piece of…
Elastic · Spain; United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
Elastic · Greece; United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
Elastic · Ireland; United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
Elastic · Portugal; United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
LangChain · Remote - US (United States)
Senior Frontend Engineer, AI Observability & Evals Platform ABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build the…
Gallup · Berlin
…engineering, AI evaluation methodologies or evaluation frameworks such as Promptfoo, DeepEval, Ragas or LangSmith preferred A commitment to working on-site at Gallup’s Berlin office at least three days per week…
Manychat · Barcelona, Spain
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…
Odysseyml · Palo Alto; Zurich; London (United States)
…Natural Capital, In-Q-Tel, Elad Gil, Jeff Dean, Guillermo Rauch, Garry Tan, Kyle Vogt, and researchers from OpenAI, DeepMind, MSL, Recursive, and Thinking Machines. WHAT WE'RE LOOKING FOR We hire deeply technical staff…
LangChain · San Francisco, CA; Boston, MA; New York, NY (United States)
FrontendEvals / LLM evaluationFrontend Engineer, AI Observability & Evals Platform ABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build the…
Cohere · Europe; London; United States; New York; United Kingdom; Toronto; Montreal (European Union)
Software (general)United KingdomRemoteAgentic workflowsEvals / LLM evaluationPrompt / context engineering…and are comfortable building integrations against external APIs. - You have a background in evaluating agentic systems (ideal), or at minimum know what an eval is and are comfortable with prompt engineering and tool-description…
Snowflake · US-CA-Menlo Park (United States)
StaffAnthropicLangGraphVercel AI SDKAgentic workflowsEvals / LLM evaluationMCP (Model Context Protocol)…with agentic AI systems and tool-use patterns, including hands-on work with SDKs like the Vercel AI SDK, Anthropic Agent SDK, LangGraph, or equivalent, you understand how to build UIs for non-deterministic, streaming,…
Justanswer · India; Bengaluru, Karnataka, India
…least one orchestration or agent framework, such as LangGraph, LangChain, Semantic Kernel, CrewAI, AutoGen, OpenAI Agents SDK, or similar. Communication: Ability to explain technical designs and complex concepts clearly to…
Cognition · San Francisco (United States)
Data / ML engineeringEvals / LLM evaluation…encoding strategies, data construction, and targeted evaluation. - Evaluation and Iteration: Build evals that distinguish real capability improvements from benchmark overfitting. Close the loop between training…
Cognition · San Francisco (United States)
Data / ML engineeringEvals / LLM evaluation…training stages, and hyperparameters that determine model behavior. Measure how choices compound across evals and production performance, not just isolated benchmarks. - Evaluation Design and Integrity: Build evals…
Manychat · Amsterdam, Netherlands
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…