Todas as vagas
Senior Machine Learning Engineer, LLM Inference Optimization
Nebius
Berlin +1 · Aceita remotoSênior (5–10 anos)Tempo integralPublicada há 15 dias
Sobre a vaga
O que você vai fazer
You will own the optimization of model and endpoint performance, focusing on latency, throughput, and cost-efficiency for frontier AI models. This involves working across the full stack to diagnose bottlenecks, implement inference engines, and deliver measurable production improvements.
O que eles procuram
Candidates must have strong Python and PyTorch engineering skills with hands-on experience in deploying or optimizing high-throughput transformer inference systems. A deep understanding of inference bottlenecks and familiarity with modern stacks like vLLM or TensorRT-LLM is essential.
Descrição completa