Lead Data Quality Automation - Python. SQL

Position: Lead Data Quality Automation - Python. SQL
Location: Santa Monica, CA
Duration: Long Term
Experience: 13 years                  

In-person interview: Yes

Mandatory Skills: Advanced SQL Queries, Python

Desirable Skills PySpark 

Job Description

We are looking for a skilled Data Quality Automation Engineer to design, develop, and maintain automated data quality frameworks that ensure accuracy, consistency, and reliability of data across platforms. The ideal candidate will have strong SQL expertise, hands-on Python experience, and experience working in modern cloud-based data ecosystems.

Roles & Responsibilities

Key Responsibilities

• Design, develop, and maintain automated data quality checks and validation frameworks
• Write complex and optimized SQL queries to analyze, validate, and troubleshoot data issues
• Develop and enhance Python-based automation scripts for data quality monitoring and reporting
• Perform data validation across Snowflake and Databricks environments
• Identify data anomalies, root causes, and proactively recommend improvements
• Collaborate with data engineers, analysts, and business stakeholders in an Agile delivery model
• Track tasks, defects, and enhancements using Jira
• Create and maintain documentation for data quality rules, processes, and automation workflows
• Support continuous improvement of data governance and quality standards

Required Skills & Experience

• Strong expertise in Advanced SQL (complex joins, window functions, performance tuning)
• Hands-on experience with Python for data processing and automation
• Experience working with Snowflake and Databricks
• Good understanding of data quality concepts (completeness, accuracy, consistency, timeliness, validity)
• Experience working in Agile/Scrum environments
• Familiarity with Jira for sprint planning and issue tracking
• Strong analytical and problem-solving skills
• Excellent communication and collaboration abilities