Title: Senior Data Engineer – Engineering Analytics & Data Visualization
Location: Washington, DC / Rockville, MD / McLean, VA (Hybrid – 3 days onsite with 2 days remote)
Duration: 6 Months with possible extension
Interview process: Phone, Onsite panel
Job Summary:
We are seeking a hands-on Senior Data Engineer to develop and maintain an engineering metrics and analytics platform. The platform integrates data from multiple engineering and development systems to provide actionable insights into software delivery, engineering productivity, and operational performance.
The ideal candidate will independently analyze complex datasets, build reliable data pipelines, identify and resolve data quality issues, and develop dashboards or lightweight applications to present meaningful business metrics.
This role requires strong technical expertise, analytical problem-solving, end-to-end ownership, and the ability to mentor junior team members.
Required Skills & Qualifications
Data Engineering
- Strong Python programming and advanced SQL skills.
- Experience building ETL/ELT pipelines integrating multiple data sources, including structured and unstructured data.
- Expertise in data transformation, aggregation, modeling, and pipeline optimization.
- Experience integrating REST APIs, including authentication, pagination, rate limits, and error handling.
- Ability to manage large datasets, incremental loads, and evolving source schemas.
Data Quality & Reliability
- Experience implementing automated data validation, reconciliation, and quality checks.
- Ability to identify and resolve missing, duplicate, inconsistent, or inaccurate records.
- Strong root-cause analysis skills for investigating data discrepancies.
- Experience developing monitoring, alerting, and exception reporting.
- Understanding of data lineage, metric definitions, and consistency across multiple systems.
Data Analytics & Visualization
- Ability to analyze complex datasets and derive actionable insights.
- Experience defining, calculating, and validating KPIs using consistent business rules.
- Strong analytical reasoning and troubleshooting skills.
- Hands-on experience developing interactive dashboards using Grafana, Splunk, Power BI, or comparable visualization tools.
- Ability to build visualizations, filters, drill-downs, and trend analysis.
- Experience developing lightweight data applications using Python frameworks such as Streamlit, Dash, or equivalent technologies.
Engineering Practices & Technical Leadership
- Strong debugging, testing, code review, documentation, and version control practices.
- Ability to independently architect and deliver end-to-end data engineering solutions.
- Experience mentoring junior engineers and establishing reusable development standards.
- Ability to translate ambiguous business requirements into technical solutions.
- Strong communication skills to explain technical findings and data quality concerns to stakeholders.
- Familiarity with AI-assisted development tools and their application to engineering and visualization workflows.
Preferred Qualifications
- Experience integrating engineering tools such as Jira, Bitbucket, GitLab, Jenkins, Splunk, and deployment platforms.
- Understanding of software development lifecycle and delivery performance metrics, including DORA metrics.
- Experience with cloud platforms, workflow orchestration, and production pipeline monitoring.
- Background in engineering productivity analytics, DevOps analytics, or developer experience initiatives.
- Experience developing executive-level reporting and visualization solutions.
Experience Requirements
- Ideally 5–8 years of relevant hands-on data engineering experience.
- Demonstrated senior-level ownership of data engineering and analytics solutions.
- Proven ability to work independently, solve complex technical problems, and provide guidance to junior engineers.
Candidate Evaluation Criteria / Qualified candidates should demonstrate:
- End-to-end ownership of multi-source data integration and analytics solutions.
- Practical experience resolving complex data quality challenges.
- Advanced Python and SQL development capabilities.
- Hands-on dashboard development and code-based visualization experience.
- Strong architectural decision-making and independent problem-solving abilities.
- Experience mentoring junior engineers.