All engineering roles
Open engineering roles from public job boards. Postings that mention AI tools come first.
59 postings
Prosus · Amsterdam (Netherlands)
Data / ML engineeringNetherlandsRemoteOpenAIAnthropicHugging FacevLLMAgentic workflowsFine-tuning / LoRA / PEFT+1 more…- State-of-the-art infrastructure: H200 GPU fleet, massive proprietary datasets, access to frontier models (OpenAI, Anthropic, Google, Together.ai http://Together.ai) for evaluation and baselines - Expert colleagues who…
Gcore · Serbia, Cyprus / Remote
…the inference layer of the Gcore Inference platform. Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM. Bring new language and multimodal models into production. Improve…
Swissquote · Gland, VD, Switzerland
…or low-latency workloads, Experience integrating applications with self-hosted AI platforms such as vLLM, Experience troubleshooting AI infrastructure integrations, including model access, GPU availability and…
ElevenLabs · United Kingdom; United States; Poland; Bulgaria
…in GPU programming and inference optimization (e.g., CUDA, Triton, TensorRT, or serving frameworks such as vLLM or SGLang). - The capacity to autonomously profile, diagnose, and eliminate bottlenecks across the serving…
OpenAI · San Francisco (United States)
…kernels, and silicon to design a production-grade runtime comparable in ambition to systems such as vLLM and SGLang, but customized and optimized for OpenAI’s AI accelerator. Your work will shape how new model…
Callosum · London (United Kingdom)
…or retrieval over structured artefacts such as codebases - Deep familiarity with the internals of SGLang, vLLM, or comparable inference serving frameworks - scheduler design, memory management, and execution pipelines…
Devoteam · Koerich, Capellen, Luxembourg
Data / ML engineeringLuxembourgAmazon BedrockVertex AIAzure OpenAIvLLMLocal / open-weight LLMsMistral+13 more…LLM Deployment : define deployment strategies across managed cloud AI services (Azure OpenAI, AWS Bedrock, GCP Vertex AI) and open-weight models (Llama, Mistral) served on GPU infrastructure via vLLM or TGI; LLMOps,…
Manychat · Barcelona, Spain
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…
Manychat · Amsterdam, Netherlands
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…
MongoDB · Sydney; Sydney, New South Wales, Australia
…want them Nice to have Experience productionizing or deploying ML model servers or inference runtimes (e.g., vLLM, Triton, TGI) Experience with observability stacks like Prometheus, Grafana, or OpenTelemetry Experience…
Roblox · San Mateo, CA, United States
…custom kernels where needed. You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining…
Databricks · San Francisco, California; Mountain View, California
…LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama) Improve reliability, latency, and…
Palantir · Seattle, WA
…systems Experience building and deploying LLMs and LLM agents using modern frameworks such as PyTorch, HuggingFace Transformers, LangChain, and vLLM Strong proficiency in Rust, Python, or C++ Bachelor's/Master's/PhD in…
Mayflower · Würzburg
…gebracht - nicht nur prototypisiert: RAG-Implementierungen, Vector Databases, Agent-Frameworks (LangGraph, OpenAI Agent SDK o. ä.), Evals und MLOps. Erfahrung mit der Integration von AI-Systemen in bestehende, gewachsene…
Mayflower · München
…gebracht - nicht nur prototypisiert: RAG-Implementierungen, Vector Databases, Agent-Frameworks (LangGraph, OpenAI Agent SDK o. ä.), Evals und MLOps. Erfahrung mit der Integration von AI-Systemen in bestehende, gewachsene…
Cloudflare · Hybrid; Austin, TX, United States; London, United Kingdom; New York, New York, United States; San Francisco, CA, United States
…serving runtime tuning. Experience with large-scale inference serving frameworks or runtimes such as SGLang, vLLM, TensorRT-LLM, ONNX Runtime, Triton, llama.cpp, or similar. Familiarity with LLMs, speech models, vision…
Lawzero · Berlin; Montreal; Berlin, Germany; Montreal, Quebec, Canada
…data-quality tasks (classifiers, LLM-based evaluators) and familiarity with LLM inference optimization (e.g. vLLM, SGLang). Familiarity with containerized deployment (Docker, Kubernetes) and infrastructure-as-code…
Bybit · Abu Dhabi, UAE; Hong Kong SAR; Kuala Lumpur, Malaysia; Kuala Lumpur Tech Office
…Practice: Familiar with at least one orchestration framework (LangGraph / Dify / Eino / Embabel / OpenAI Agents SDK, etc.); hands-on experience with Multi-Agent collaboration (Agent Teams / parallel / DAG /…
Fastlta · München
…sowie eine eigenständige, strukturierte Arbeitsweise Erfahrung mit LLMs, RAG-Systemen oder AI-Infrastruktur (vLLM, LangChain, Vektordatenbanken) ist ein klares Plus, aber kein Muss Fließende Deutschkenntnisse auf…
Multiversecomputing · Donostia, Spain
…with deep learning model compression techniques and inference optimization engines (TensorRT, vLLM, etc.). Experience in the evaluation of Generative AI systems on real live data. Perks & Benefits Indefinite…
Xai · London, England, United Kingdom
…best practices Experience with LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM) Experience designing or building with agent SDKs and agent orchestration frameworks Experience with Docker,…
UbiOps · The Hague
…deploying or managing workloads on Kubernetes Familiarity with GPUs and related technology (NVIDIA, vLLM) Linux (Debian/Ubuntu) system management Networking and load balancing Infrastructure as code technologies…
Lawzero · Berlin; Montreal; Berlin, Germany; Montreal, Quebec, Canada
…and implementing distributed ML training frameworks, with recent experience using e.g. Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, and/or verl. Ability to collaborate effectively with cross-functional teams, document…
Cohere · New York; San Francisco; Toronto; Montreal (United States)
…- Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.) - Ability to diagnose and resolve performance bottlenecks across the model execution stack…
Doctolib · Paris (France)
…RAG systems, or reinforcement learning - You are expert in Python, PyTorch/Transformers for training, vLLM/similar for inference with a track record deploying ML systems in production (AWS/GCP) - You have…
AlterSolutions · Warsaw, Masovian Voivodeship, Poland
…distributed computing (Ray.io), and data labeling platforms (Label Studio). Managed ML services (SageMaker, Vertex AI. Location: Hybrid in Warsaw ; Long-term cooperation ( 2+ years ); Type of contract: B2B ; Rate: 250 PLN/H net…
Buhl Data Service GmbH · Mannheim
…beim Aufbau und Betrieb unserer KI-Infrastruktur, z. B. beim Deployment von Modellen mit Triton oder vLLM auf Kubernetes. Docker: Du bringst Docker-Kenntnisse mit, um lokale Entwicklungsumgebungen oder…
Xai · Palo Alto, CA; Seattle, WA; Palo Alto, CA
…with large-scale, high-concurrent production serving Experience with GPU inference engines (e.g., vLLM, SGLang, Triton, TensorRT-LLM) Strong background in system optimizations: batching, caching, load balancing,…
UbiOps · The Hague
…deploying or managing workloads on Kubernetes Familiarity with GPUs and related technology (NVIDIA, vLLM) Linux (Debian/Ubuntu) system management Networking and load balancing Infrastructure as code technologies…