Senior Data Platform Engineer
About the job
What you'll do
Design, build, and operate scalable batch and streaming data pipelines on Databricks, while leading legacy pipeline migrations and contributing to platform architecture, engineering standards, and best practices. Improve platform performance, cost, governance, and reliability; evaluate new Databricks capabilities; and mentor colleagues through code reviews and pairing.
What they're looking for
Requires at least 3 years of production Databricks experience, strong SQL, PySpark, and Python skills, and experience building and operating batch and streaming pipelines. Candidates should also have CI/CD and infrastructure-as-code experience, knowledge of data modeling, governance, security, and cloud cost optimization, and the ability to contribute to architectural decisions and communicate trade-offs.