All engineering roles
Open engineering roles from public job boards. Postings that mention AI tools come first.
309 postings
Xai · Palo Alto, CA
Software (general)Evals / LLM evaluation…runs all our evaluations at scale Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation…
Nscaleoperationsukltd · Houston; New York; San Francisco; Seattle; Houston; New York; San Francisco; Seattle
…AI infrastructure team Maintainer or core contributor to a foundational inference, kernel, or RL framework (vLLM, SGLang, TensorRT-LLM, LMCache, FlashInfer, Triton, verl, OpenRLHF, TRL, DeepSpeed, Megatron-LM,…
Elastic · Poland; United Kingdom
…every agent. You'll help set the correctness bar, making sure the skills and tools we ship are backed by evals rather than assumed to work. You'll design and deliver integrations that make Elastic available inside…
MongoDB · Gurugram; Gurugram, Haryana, India
Software (general)LangGraphAgentic workflowsEvals / LLM evaluationRAGFine-tuning / LoRA / PEFTVector databases…React Experience with model evaluation frameworks, vector databases, or agent orchestration tooling (e.g., LangGraph) Familiarity with transformer architecture and model internals Familiarity with containerized applications,…
Bloomreach · India; India_Region
…in English, both verbal and written. Preferred Qualifications ● Prior experience building or working with LLM evaluation frameworks. ● Hands-on experience implementing hybrid search architectures. More things you'll like about…
Vocali · Murcia Híbrido
Software (general)SpainSpanishAmazon BedrockAmazon SageMakerLangGraphLLM observabilityAgentic workflowsEvals / LLM evaluation+3 more…modelos según calidad, latencia, coste, privacidad y disponibilidad; trabajarás con proveedores como AWS Bedrock y otras APIs de modelos sin acoplar la arquitectura a uno solo. Observabilidad y evaluación: Instrumentarás…
Snowflake · US-CA-Menlo Park; US-WA-Bellevue (United States)
StaffRemoteLLM observabilityAI / agent harnessAgentic workflowsEvals / LLM evaluationRAGGuardrails+1 more…models, or agent architectures. - Familiarity with eval and observability tooling (e.g., Braintrust, LangSmith, Arize, Weave, Promptfoo) or experience building custom eval harnesses. - Experience with failure-mode…
Perplexity · San Francisco (United States)
…THE ROLE In 2026, we launched Computer, the defining product for the new era of agentic AI. Millions of people now use Perplexity to transform knowledge into action, through Search, Comet, and…
Mapbox · Mapbox US (United States)
Data / ML engineeringAI / agent harnessMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)…You can describe a dataset you built and the failure it caught. - Working knowledge of more than one agent harness, and opinions about where each of them is weak. - Experience diagnosing latency in a distributed…
Scopely · ES - Spain; Dublin
Security engineeringSpainGame studioAgentic workflowsMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)Guardrails…employee, player, business partner, and non-human identities by building AI-native identity workflows: agentic systems that handle provisioning, access reviews, and remediation within explicit guardrails, with humans approving…
Workwize · Amsterdam ; Amsterdam
…than raise it and wait. Nice to have Experience at a fast growing SaaS or B2B product company. Running evals, watching inference cost, or dealing with model failure modes like hallucination in production. Experience…
ClickHouse · Germany; Portugal; France; Spain; Italy; The Netherlands
…database engineering team one channel away. - Build new infrastructure-heavy features: things like LLM-as-a-Judge (where we post-process large volumes of ingested data asynchronously), alerting at scale, client-code…
Snowflake · US-CA-Menlo Park (United States)
StaffRemoteAgentic workflowsEvals / LLM evaluationRAGPrompt / context engineeringVector databasesGuardrails…IN THIS ROLE: - Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management. - Scale Context Engineering Infra: Design…
Mapbox · Mapbox Helsinki (Finland)
Data / ML engineeringFinlandRemoteAI / agent harnessMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)…hallucinated arguments, silent partial success, unbounded loops. - Working knowledge of more than one agent harness, and opinions about where each of them is weak. - Strong Python or TypeScript, and comfort reading code in…
Prismic · Remote, France / Remote
Software (general)FranceRemoteLangChainLangGraphVercel AI SDKAgentic workflowsEvals / LLM evaluationVector databases…systems that ran under real traffic and failed in interesting ways. Hands-on work with LangGraph or LangChain, or an equivalent stack such as the Vercel AI SDK. Fluency with model APIs at the level that matters: system…
Databricks · San Francisco, California
…workflows and the systems running them. Collaborate with partner teams to enable use cases like RAG and AI agents. Build Agentic SDKs with strong evaluations. Ideal Engineer should have: 5+ years of experience writing…
Mai Group · Remote; München; Paderborn; Köln; Wien; Hamburg; Berlin
Data / ML engineeringGermanyRemoteGermanvLLMOllamaLangGraphLLM observabilityEvals / LLM evaluationRAG+4 more…pgvector, Qdrant oder Neo4j Kubernetes sowie Erfahrung mit selbst betriebenen LLMs und Inferenz-Stacks wie vLLM oder Ollama Erfahrung mit Werkzeugen für LLM-Evaluation und Observability, beispielsweise Langfuse Erfahrung…
Nscaleoperationsukltd · Houston; New York; San Francisco; Seattle; Houston; New York; San Francisco; Seattle
…and sharing infrastructure between inference and training Serving platform and APIs: serving engines (vLLM, SGLang, TensorRT-LLM), model onboarding, and OpenAI-compatible APIs that other engineers and customers build…
Aircallioinc · San Francisco Office
Data / ML engineeringAgentic workflowsEvals / LLM evaluationRAGPrompt / context engineeringFine-tuning / LoRA / PEFT…/ PhD in Computer Science, Machine Learning, Statistics, or related field Experience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation) Experience with synthetic data generation and prompt…
Mbio · Hybrid, Portugal
Data / ML engineeringPortugalAgentic workflowsEvals / LLM evaluationMCP (Model Context Protocol)RAGPrompt / context engineeringEmbeddings+2 more…AI-powered applications with LLMs , including prompting strategies, structured outputs, tool integration, or agentic workflows. Strong understanding of AI system design, agent architectures, orchestration patterns, state management, and…
Doctolib · Paris (France)
Data / ML engineeringFranceRemoteHugging FaceVertex AIEvals / LLM evaluationRAGEmbeddingsVector databases…in named entity recognition, classification, and retrieval. Read the DoctoBERT practical guide https://huggingface.co/blog/hugging-science/doctobert-cookbook#introduction to learn more about how we bring deep AI research…
LangChain · Boston, MA; New York, NY (United States)
Full stackEvals / LLM evaluationSenior Fullstack Engineer, AI Observability & Evals Platform ABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build the…
LangChain · Boston, MA; New York, NY (United States)
BackendEvals / LLM evaluationSenior Backend Software Engineer, AI Observability & Evals Platform (LangSmith) ABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build…
Mapbox · Mapbox UK (United Kingdom)
Data / ML engineeringUnited KingdomRemoteAI / agent harnessMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)…hallucinated arguments, silent partial success, unbounded loops. - Working knowledge of more than one agent harness, and opinions about where each of them is weak. - Strong Python or TypeScript, and comfort reading code in…
Mapbox · Mapbox Germany
Data / ML engineeringGermanyRemoteAI / agent harnessMulti-agent systemsEvals / LLM evaluationMCP (Model Context Protocol)…You can describe a dataset you built and the failure it caught. - Working knowledge of more than one agent harness, and opinions about where each of them is weak. - Experience diagnosing latency in a distributed…
Xm · Limassol; Nicosia; Athens; Thessaloniki; Fully Remote - in other eligible locations
QA / Test / SDETCyprusRemoteAmazon BedrockVertex AILLM observabilityAI / agent harnessAgentic workflowsMulti-agent systems+6 more…to take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock AgentCore-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs,…
Allyourbi · Rotterdam, Netherlands
Data / ML engineeringNetherlandsOpenAIAnthropicEvals / LLM evaluationRAGVector databasesAI security+2 more…and demos. Strong Python, and you know the modern AI stack (LLM APIs across providers like Anthropic / OpenAI / open models, vector databases, an orchestration framework) well enough to know where it breaks. Reliability…
Isomorphiclabs · London; London, England, United Kingdom
…opportunities. Evaluate and deploy frameworks for supervised fine-tuning, reinforcement learning and LLM evaluation. Diagnose and fix performance bottlenecks and communication overhead in distributed training and inference…
Anthropic · San Francisco, CA | New York City, NY; San Francisco, California, United States
Data / ML engineeringEvals / LLM evaluation…and product launches: testing new models to understand their strengths and limitations, building demos and evals, and helping field teams get ready. When strategic customers hit novel challenges, you'll go hands-on to…
Anthropic · San Francisco, CA | New York City, NY; San Francisco, California, United States
…Science already renders protein structures, genome tracks, and chemical structures natively, and coordinates multi-agent workflows with built-in review for citation and calculation errors — and we’re just getting started. Much of…