Senior Data Engineer (Data Quality)

Overview

Responsible to evolve Data Quality capabilities and improve quality of NFCU data assets in Azure Cloud, this includes Enterprise Data Lake, Data Warehouse, and Data Hubs. This role will partner with Enterprise Data Governance stakeholders to generate product roadmap that aligns to strategic goals, assess current state capabilities to understand gaps, define architecture and design, and implement. The candidate will lead and hands-on coding to mature Databricks based bespoke framework that controls and monitors Data Quality. The ideal candidate will also have experience in test automation, building test suites for data pipelines to ensure reliable data delivery. Additionally, the candidate will have experience in working with industry leading COTS solution on Data Quality to mature NFCU Data Quality coverage and effectiveness in Azure Cloud.

Responsibilities

• Establish and lead Data Quality Center of Excellence to govern and mature technology and process
• Collaborate with key stakeholders to generate Enterprise Data Quality product roadmap
• Assess and identify Data Quality gaps and challenges to improve in Azure Cloud, prioritize the efforts, and lead engineering team to implement
• Collaborate with stakeholders and engineers to assess COTS solution on data quality tools, evaluate options and define future state
• Define architecture and design that matures data quality solution for batch and data streaming services
• Evolve inline Data Quality framework for batch data processing in Azure cloud
• Enable Data Quality monitoring and alerts for Data Streaming services
• Apply Data Quality dimension principles to improve and measure quality of data
• Deliver key Data Quality metrics to measure the success of the efforts for business stakeholders
• Evolve and enforce data engineering standards for Data Quality
• Develop automated tests using Python or enhance existing custom PySpark-based test frameworks
• Integrate test suites into CI/CD pipelines to ensure continuous validation of data pipelines
• Collaborate with data teams to ensure robust test coverage and support test-driven development practices
• Generate Monthly Status Report for Data Quality efforts and review with leadership
• Provide technical direction and leadership routinely to other engineers; serve as a coach and mentor
• Perform other duties as assigned

Qualifications

• Bachelor's degree in information systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training, and experience
• Expertise in delivering and improving data quality in a Big Data environment in cloud for Enterprise Data Lake (Azure or similar), Data Warehouse (Azure Synapse or similar), and Data Hubs (Azure Cosmos DB or similar)
• Expertise in data processing (Databricks ETL, Azure Event Hub, Azure Functions, or similar), data quality solution (Acceldata, Ataccama, Anomalo, or similar), data governance solution (Unity Catalog, Alation, Azure Purview or similar)
• Expertise in enabling error handling, data validation, data reconciliation, data quality monitoring and alert
• Experience with processing various file types in Data Lake. (Delta, JSON, Parquet or similar)
• Strong understanding of data quality principles and best practices
• Proficiency in programing languages such as SQL, Python & Spark
• Experience with DevOps toolset (Azure DevOps or similar) to collaborate and deploy code
• Experience in Test case design, execution, and defect tracking
• Familiarity with QA methodologies (e.g., Agile, Scrum)
• Excellent verbal and written communication skills, with the ability to effectively communicate complex concepts to stakeholders at all levels

Hours: Monday - Friday, 8:00AM - 4:30PM

Location: 820 Follin Lane, Vienna, VA 22180

About Us
Navy Federal provides much more than a job. We provide a meaningful career experience, including a culture that is energized, engaged and committed; and fierce appreciation for our teams, who are rewarded with highly competitive pay and generous benefits and perks.

Our approach to careers is simple yet powerful: Make our mission your passion.

Best Companies for Latinos to Work for 2024

Computerworld Best Places to Work in IT

Forbes 2025 America's Best Large Employers

Forbes 2024 America's Best Employers for New Grads

Forbes 2024 America's Best Employers for Tech Workers

Fortune Best Workplaces for Millennials 2024

Fortune Best Workplaces for Women 2024

Fortune 100 Best Companies to Work For 2025

Military Times 2024 Best for Vets Employers

Newsweek Most Loved Workplaces

2024 PEOPLE Companies That Care

Ripplematch Recruiting Choice Award

Yello and WayUp Top 100 Internship Programs

From Fortune . 2025 Fortune Media IP Limited. All rights reserved. Used under license. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, Navy Federal Credit Union.

Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected Veteran.

Disclaimers: Navy Federal reserves the right to fill this role at a higher/lower grade level based on business need. An assessment may be required to compete for this position. Job postings are subject to close early or extend out longer than the anticipated closing date at the hiring team's discretion based on qualified applicant volume. Navy Federal Credit Union assesses market data to establish salary ranges that enable us to remain competitive. You are paid within the salary range, based on your experience, location and market position

Bank Secrecy Act: Remains cognizant of and adheres to Navy Federal policies and procedures, and regulations pertaining to the Bank Secrecy Act.