All jobs
Senior Software Engineer - LLM Ops & Evals
Amsterdam · HybridSenior (5–10 years)Full-timePosted 15 Sep 2026
About the job
What you'll do
You will own the LLM gateway infrastructure, including routing, failover, and cost attribution across multiple providers. Additionally, you will build and maintain a shared evaluation platform to measure AI quality through versioned datasets and experiment tracking.
What they're looking for
Candidates must have 5+ years of experience in backend or platform engineering with strong production Python skills. You should also have hands-on experience managing LLM inference infrastructure and cloud-based systems using infrastructure as code.
Full description