Todas as vagas
Senior ML Engineer | Kimchi (Inference Stack Optimization)
Cast AI
Holanda · Aceita remotoSênior (5–10 anos)Tempo integralPublicada há 15 dias
Sobre a vaga
O que você vai fazer
You will own the optimization of the inference stack to improve throughput, latency, and cost-efficiency. This involves tuning loaders, schedulers, and kernels while managing distributed inference topologies and quantization strategies.
O que eles procuram
You must have 5+ years of experience building real ML systems with deep expertise in inference infrastructure. Proficiency in Python and hands-on experience with engines like vLLM or SGLang are required.
Descrição completa