Sr Data Quality Engineer Lead

Job Title: Sr Data Quality Engineer

Chicago. IL

Job Description: Data Quality Engineering & FrameworksDesign and implement enterprise-wide data quality frameworks aligned to Lakehouse architecture (bronze, silver, gold layers)
Define and enforce data quality rules including completeness, accuracy, consistency, timeliness, and validity
Develop reusable data validation, reconciliation, and monitoring patterns within Databricks pipelines
Experience working with large-scale datasets in cloud environments (AWS or Azure)
Experience integrating data quality into ELT/ETL pipelines and orchestration tools
Databricks & Pipeline Integration Integrate data quality controls directly into Databricks (Spark/Delta Lake) pipelines and workflows
Lead root cause analysis (RCA) efforts for data quality issues and drive remediation
Data Governance & ComplianceEnsure adherence to enterprise data governance standards, including metadata, lineage, and auditability


Technical Skills Databricks (Lakehouse, Unity Catalog, workflows)
Spark / PySpark
SQL (advanced)
Delta Lake
Data quality frameworks (rule engines, validation patterns)
Data observability and monitoring