Overview
Skills
Job Details
Job Title: Senior Data Engineer
Location: 100% Remote - Contractor roles -Washington, DC
Duration: Long Term Contract
Responsibilities
- Support a data product track.
- Work with data analyst.
- Work on day-to-day operations - on rotation basis, 6pm 6am (not that often though).
- Infrastructure upgrades, any special projects etc..
MUST HAVEs:
- 5-10 + years Exp.
- Ab Initio developer role with AWS Tech stack
- Ab Initio CDC
- Hadoop
- Help with design.
- Team player and hit the ground running from day 1.
- On call support on rotation basis (rarely they will get a call).
- ETL processing to support data products.
Preferred:
Hive technology, ProSQL.
Certifications.
Healthcare Insurance background
Interview Process:
2 rounds MS Teams video - 1st - with Hiring Manager and 2nd will be an hour long brutal technical interview with panel.
Purpose
We are seeking a highly skilled Senior Data Engineer to lead the design, deployment, and scaling of data infrastructure across cloud and on-premise environments. This
role is pivotal in enabling data-driven decision-making and delivering meaningful insights through robust data platforms.
Key Responsibilities
- Infrastructure Development (20%) -Architect and maintain scalable data systems including data lakes, warehouses, and APIs using modern technologies.
- Data Analysis & Reporting (15%) - Apply statistical techniques to interpret data and generate actionable insights for strategic initiatives.
- Data Modeling (15%) - Design and optimize data models, ensuring alignment with metadata standards and data lifecycle best practices
- Data Collection Frameworks (15%) -Build frameworks to capture structured and unstructured data from diverse sources.
- Continuous Learning & Innovation (15%) -Stay current with industry trends through workshops, publications, and professional networking.
- ETL/ELT Development (10%) -Develop and maintain efficient data pipelines using Ab Initio within the AWS ecosystem.
- Best Practices Implementation (10%) -Ensure systems meet high standards for scalability, reliability, auditing, and performance.
Required Qualifications
Education: Bachelor s degree in Computer Science, Information Technology, Engineering, or related field. (In lieu of a degree, 4 additional years of relevant experience required.)
Experience:
- 5+ years in database design, data modeling, and ETL/ELT development.
- Hands-on experience in Ab Initio development within AWS ecosystem.
Experience with
Ab Initio EKS and Hadoop platforms.
Skills & Expertise
Must-Have Skills:
Ab Initio (including EKS)
Hadoop
AWS
Programming Languages: SQL, NoSQL, Python
Expertise:
Data architecture & modeling
Data movement & exchange format
Analytical problem-solving
Strong communication & organizational skills
Work Environment
Fast-paced, dynamic setting with shifting priorities and deadlines.
Requires excellent customer service and adaptability to meet internal and external demands.