Senior / Lead Software Engineer (Python & Databricks) - Only W2

Structure the engine as Python packages, with the pricing logic apart from data access and orchestration.

Rewrite step by step SQL logic as vectorised computation, on Spark or on one machine, as each workload needs.

Build the tests: unit, integration, and comparison against the current engine's results.

Automate deployment with CI / CD and Databricks Asset Bundles.

Make runs observable, safe to repeat and safe to run side by side.

Bring AI agents into the team's development process, with checks on what they produce.

5 or more years of production Python: object oriented design, packaging, type hints, testing.

The numerical stack beyond Spark, such as NumPy, pandas or Polars: vectorised and parallel execution, decimal against floating point accuracy.

Production workloads shipped on Databricks: jobs, Unity Catalog, Delta Lake, Asset Bundles, medallion design.

How Spark runs work: query plans, shuffles, partitioning, skew, and tuning from measurements.

CI / CD, Git workflow, infrastructure as code, logging and monitoring.

Daily use of AI coding agents, and agentic development workflows with checks on their output.

Takes a design to production with little guidance, and leads a team by example.

Insurance, reinsurance or other financial risk calculations.

Reading T-SQL, the reference for the current logic.

Azure Data Factory and Azure SQL.

Testing in a regulated setting.