Overview
Skills
Job Details
Role: Senior Data Quality Engineer
Duration: Long term
Location: Washington, DC (Need Locals)
Note: Ex- Amtrak or Rail road experience or any transportation domain exp resources
Key Responsibilities:
- Automate Data Quality at Scale
Design and implement automated data profiling, validation, and anomaly detection pipelines using modern frameworks and toolsets ensuring data issues are caught early and resolved quickly.
- Build Reusable Quality Components
Develop scalable, reusable modules for rule enforcement, anomaly detection, and schema validation to ensure consistent, efficient quality checks across pipelines.
- Embed Governance into Engineering
Translate data governance policies such as critical field checks, certified source validation, and data ownership rules into enforceable logic and embedded controls.
- Integrate with Modern Platform
Use and extend tools like Databricks, SAP DataSphere, and Informatica Cloud to implement quality controls across the stack while remaining tool-flexible for future growth.
- Collaborate Across the Stack
Partner with data engineers, governance leads, analysts, and product owners to align on quality expectations, drive accountability, and ensure business context is reflected in technical rules.
- Measure and Communicate Data Health
Monitor, document, and report on data quality metrics, including rule compliance, anomalies, and issue resolution providing transparency to both technical and business stakeholders.
Technical Skills:
- Strong command of SQL and Python for developing rule logic and profiling scripts
- Experience with quality frameworks like Great Expectations, Deequ, or custom solutions
- Familiarity with platforms like Databricks, Informatica, SAP DataSphere, and cloud data services (AWS, Azure, or Google Cloud Platform)
- Working knowledge of data governance, including certified datasets, critical data elements, ownership, and data policy enforcement