Overview
On Site
Depends on Experience
Full Time
Skills
Databricks
Delta Lake
Spark (Scala/Python)
SQL/PL-SQL and performance tuning
Job Details
Senior Data Engineer
Location: on-site (DC Metro area) with occasional Remote
Clearance: Public Trust (or ability to obtain),
Type: Full-time
Overview:
Seeking a Senior Data Engineer to support an enterprise-scale data-lake modernization effort. This role will help design, develop, and sustain large analytical data platforms using Databricks, Informatica, Oracle, AWS services, and related technologies.
Responsibilities:
- Develop scalable data pipelines using Databricks (E2), Delta Lake, Spark, Scala, Python
- Integrate high-volume inbound/outbound data interfaces across ODS and analytical marts
- Enhance existing data lakes, data ponds, and analytical environments
- Implement data quality, validation, and governance frameworks using Informatica IICS
- Support real-time and batch ETL/ELT pipelines
- Collaborate with engineering, DevSecOps, and cloud teams
- Tune large-scale queries in Oracle, PostgreSQL, and Redshift
- Maintain legacy systems while modernizing the tech stack
- Support automated deployment using Jenkins, Liquibase, GitHub
- Produce architecture documentation, SOPs, and CONOPS
Required Skills:
- 7+ years Data Engineering experience
- Expertise in Databricks, Delta Lake, Spark (Scala/Python)
- Advanced SQL/PL-SQL and performance tuning
- AWS services: S3, Glue, Lambda, Athena, Kinesis, RDS, DMS
- Informatica IICS / Data Quality tools
- CI/CD (Jenkins, GitHub, Liquibase)
- Experience with enterprise data warehousing
Preferred:
- SAS, Tableau, Oracle Analytics Server
- Senzing, Graph Data Services
- Section 508 knowledge
- Experience with federal programs
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.