All engineering roles
Open engineering roles from public job boards. Postings that mention AI tools come first.
173 postings
Snowflake · US-WA-Bellevue (United States)
…production. - Familiarity with GPU and LLM infrastructure — e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM; able to debug across the data, infrastructure, and GPU layers. - Demonstrated ability to harden complex…
Mai Group · Remote; München; Paderborn; Köln; Wien; Hamburg; Berlin
Data / ML engineeringGermanyRemoteGermanvLLMOllamaLangGraphLLM observabilityEvals / LLM evaluationRAG+4 more…pgvector, Qdrant oder Neo4j Kubernetes sowie Erfahrung mit selbst betriebenen LLMs und Inferenz-Stacks wie vLLM oder Ollama Erfahrung mit Werkzeugen für LLM-Evaluation und Observability, beispielsweise Langfuse Erfahrung…
Nscaleoperationsukltd · Houston; New York; San Francisco; Seattle; Houston; New York; San Francisco; Seattle
…and sharing infrastructure between inference and training Serving platform and APIs: serving engines (vLLM, SGLang, TensorRT-LLM), model onboarding, and OpenAI-compatible APIs that other engineers and customers build…
Prosus · Amsterdam (Netherlands)
Data / ML engineeringNetherlandsRemoteOpenAIAnthropicHugging FacevLLMAgentic workflowsFine-tuning / LoRA / PEFT+1 more…- State-of-the-art infrastructure: H200 GPU fleet, massive proprietary datasets, access to frontier models (OpenAI, Anthropic, Google, Together.ai http://Together.ai) for evaluation and baselines - Expert colleagues who…
Gcore · Serbia, Cyprus / Remote
…the inference layer of the Gcore Inference platform. Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM. Bring new language and multimodal models into production. Improve…
Mirakllabs · Bordeaux, France; Paris, France
…quality and reliability Team capability growth Our stack and tools Languages: Python and SQL AI Stack: OpenAI, Anthropic, Gemini, Mistral and Open-source models Agentic & Retrieval: LangGraph, LangChain, LlamaIndex, MCP…
Mirakllabs · Paris, France
…quality and reliability Team capability growth Our stack and tools Languages: Python and SQL AI Stack: OpenAI, Anthropic, Gemini, Mistral and Open-source models Agentic & Retrieval: LangGraph, LangChain, LlamaIndex, MCP…
Twodaydenmark · København, Denmark
Data / ML engineeringDenmarkLocal / open-weight LLMsRAGPrompt / context engineeringFine-tuning / LoRA / PEFTResponsible AIGuardrails…LLM frameworks Experience with RAG, prompt design, tool calling and structured outputs Knowledge of local or self-hosted models and inference infrastructure Experience with Docker, Linux, APIs and CI/CD A pragmatic approach to…
Swissquote · Gland, VD, Switzerland
…or low-latency workloads, Experience integrating applications with self-hosted AI platforms such as vLLM, Experience troubleshooting AI infrastructure integrations, including model access, GPU availability and…
ElevenLabs · United Kingdom; United States; Poland; Bulgaria
…in GPU programming and inference optimization (e.g., CUDA, Triton, TensorRT, or serving frameworks such as vLLM or SGLang). - The capacity to autonomously profile, diagnose, and eliminate bottlenecks across the serving…
Tradingview · Limassol, Cyprus; Tbilisi, Georgia
…automation Choosing and evaluating appropriate approaches — including external AI providers, open-source or self-hosted models, as well as traditional ML/NLP methods Contributing to the architecture of ML solutions, shaping technical…
OpenAI · San Francisco (United States)
…kernels, and silicon to design a production-grade runtime comparable in ambition to systems such as vLLM and SGLang, but customized and optimized for OpenAI’s AI accelerator. Your work will shape how new model…
Callosum · London (United Kingdom)
…or retrieval over structured artefacts such as codebases - Deep familiarity with the internals of SGLang, vLLM, or comparable inference serving frameworks - scheduler design, memory management, and execution pipelines…
Devoteam · Koerich, Capellen, Luxembourg
Data / ML engineeringLuxembourgAmazon BedrockVertex AIAzure OpenAIvLLMLocal / open-weight LLMsMistral+13 more…LLM Deployment : define deployment strategies across managed cloud AI services (Azure OpenAI, AWS Bedrock, GCP Vertex AI) and open-weight models (Llama, Mistral) served on GPU infrastructure via vLLM or TGI; LLMOps,…
Epic Games · Montreal,Quebec,Canada; Cary, North Carolina, United States
…of: Foundational models and vision and/or language, incl. local deployment and model post-training of open weights models Memory, state, or long-horizon behaviour in foundation models: your experience may come from language agents…
Epic Games · Porto Alegre,Rio Grande do Sul,Brazil; Cary, North Carolina, United States
…of: Foundational models and vision and/or language, incl. local deployment and model post-training of open weights models Memory, state, or long-horizon behaviour in foundation models: your experience may come from language agents…
Wongdoody · Belgrade, SE; Belgrade, Belgrade, Serbia
…Adobe Firefly into broader workflow systems Proven experience integrating text-based AI APIs like ChatGPT, Claude, Gemini, or Llama into end-to-end workflow solutions Familiarity with prompting techniques, RAG pipelines,…
Manychat · Barcelona, Spain
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…
Epic Games · BLANK,BLANK,Multiple Locations; Cary, North Carolina, United States
…of: Foundational models and vision and/or language, incl. local deployment and model post-training of open weights models Memory, state, or long-horizon behaviour in foundation models: your experience may come from language agents…
Epic Games · London,England,United Kingdom; Cary, North Carolina, United States
…of: Foundational models and vision and/or language, incl. local deployment and model post-training of open weights models Memory, state, or long-horizon behaviour in foundation models: your experience may come from language agents…
Epic Games · Cary,North Carolina,United States; Cary, North Carolina, United States
…of: Foundational models and vision and/or language, incl. local deployment and model post-training of open weights models Memory, state, or long-horizon behaviour in foundation models: your experience may come from language agents…
Manychat · Amsterdam, Netherlands
…scale. - Hands-on experience operating LLM-backed systems in production: provider APIs (Bedrock, OpenAI, Anthropic, or similar), inference pipelines, self-hosted or managed model serving. - Deep cloud-native…
MongoDB · Sydney; Sydney, New South Wales, Australia
…want them Nice to have Experience productionizing or deploying ML model servers or inference runtimes (e.g., vLLM, Triton, TGI) Experience with observability stacks like Prometheus, Grafana, or OpenTelemetry Experience…
Eraneos · Hamburg, München, Düsseldorf, remote
…SQLAlchemy, Pydantic) KI- & NLP-Expertise: Du verfügst über praktische Erfahrung mit NLP und LLMs wie GPT, Claude, Gemini, Llama oder Deepseek Grundlagen des Data Engineering: SQL und die Arbeit mit Datenbanken sind für…
Roblox · San Mateo, CA, United States
…custom kernels where needed. You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining…
Databricks · San Francisco, California; Mountain View, California
…LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama) Improve reliability, latency, and…
Palantir · Seattle, WA
…systems Experience building and deploying LLMs and LLM agents using modern frameworks such as PyTorch, HuggingFace Transformers, LangChain, and vLLM Strong proficiency in Rust, Python, or C++ Bachelor's/Master's/PhD in…
Palantir · Palo Alto, CA
Software (general)Local / open-weight LLMs…that combine sensors, actuators, unmanned vehicles, and intelligent decision-making systems including self-hosted and commercial LLMs to enable users to employ and manage robotic and autonomous systems across a variety of mission sets. You…
Palantir · Washington, D.C.
Software (general)Local / open-weight LLMs…that combine sensors, actuators, unmanned vehicles, and intelligent decision-making systems including self-hosted and commercial LLMs to enable users to employ and manage robotic and autonomous systems across a variety of mission sets. You…
ASIFR · Nantes, Pays de la Loire, France
…à jour des corpus ; intégrer des LLM dans des architectures applicatives robustes : Mistral, Azure OpenAI, OpenAI, Claude, Bedrock ou modèles internes ; développer des assistants conversationnels et des agents IA capables…