All jobs
Senior ML Engineer | Kimchi (Inference Stack Optimization)
Kimchi
Netherlands · Remote possibleSenior (5–10 years)Full-timePosted 15 days ago
About the job
What you'll do
You will be responsible for optimizing the inference stack to improve throughput, latency, and cost-efficiency. This includes tuning loaders, schedulers, and kernels while managing distributed inference topologies and KV cache performance.
What they're looking for
You must have 5+ years of experience building real ML systems with deep expertise in inference or training infrastructure. Proficiency in Python and hands-on experience with engines like vLLM, SGLang, or TensorRT-LLM is required.
Full description