We are seeking a Senior Data Quality Engineer with strong experience in Python, SQL, and automated data testing frameworks. This role focuses on building scalable data quality and validation frameworks for modern data pipelines in a Databricks environment.
Key Responsibilities:
• Build and maintain automated testing frameworks for data pipelines
• Validate data ingestion, transformations, and data quality across multiple sources
• Implement data quality tools such as Great Expectations, dbt tests, or similar
• Integrate testing into CI/CD pipelines
• Collaborate with engineering teams to improve data reliability and observability
Required Skills:
• 5+ years of experience in Data Quality Engineering, Data Engineering, or related field
• Strong hands-on experience with Python and SQL
• Experience with automated testing frameworks and pipeline validation
• Familiarity with Databricks, data transformation workflows, and CI/CD tools
• Strong problem-solving and communication skills
Preferred:
• Experience with PySpark, Delta Lake, Kafka, or Azure cloud technologies
• Exposure to AI-assisted development tools and data observability practices