Data Engineer Senior @ Raleigh, NC (Hybrid)

Role: Data Engineer   Senior
 Location: 301 N. Wilmington St, Raleigh, NC (Hybrid)
Duration: Long-Term Contract
 Experience: 10+ Years
 

Job Summary

We  seeking a Senior Data Engineer with strong experience in data engineering, ETL development, and data quality assurance. The primary responsibility is to ensure the integrity, accuracy, and reliability of data as it moves from a shared file transfer service to Amazon S3, through Snowflake, and into downstream applications and reporting systems.

The ideal candidate will have expertise in Python, SQL, cloud technologies, ETL pipelines, and data quality management, along with strong analytical and collaboration skills.

Key Responsibilities

• Design, develop, and maintain robust ETL pipelines for data ingestion and transformation.

• Implement data quality assurance (QA) and validation processes throughout the ETL lifecycle.

• Ensure accurate data movement from shared file transfer services to Amazon S3 and Snowflake.

• Monitor, troubleshoot, and optimize data pipelines to maintain reliable data flow.

• Identify and resolve data quality issues, including source data inconsistencies that may cause ingestion failures or data rollbacks.

• Collaborate with business owners, data analysts, BI teams, and other stakeholders to understand business requirements and deliver high-quality data solutions.

• Translate business requirements into scalable technical solutions.

• Follow secure coding practices and cybersecurity standards related to data engineering and DevOps.

• Support Agile development processes and participate in planning, development, and deployment activities.

Required Qualifications

• 5+ years of experience in Data Engineering with a strong focus on:

  • Data Quality Assurance

  • Data Validation

  • ETL Development

• 5+ years of experience with:

  • Python

  • PyPI

  • SQL

• Strong understanding of:

  • Data Quality Management

  • ETL Architecture

  • Data Integration

  • Data Pipeline Monitoring

• Experience with:

  • Amazon S3

  • Snowflake

  • Public Cloud platforms

• Knowledge of cybersecurity principles related to:

  • Secure code development

  • DevOps

  • Data access and governance

• Strong analytical and problem-solving skills.

• Ability to gather business requirements and translate them into technical solutions.

• Excellent communication and stakeholder collaboration skills.

• Experience working in Agile environments.

Preferred Technical Skills

• Snowflake

• Amazon S3

• Python

• SQL

• PyPI

• ETL Development

• Data Quality / Data Validation

• Data Integration

• Public Cloud

• DevOps

• Cybersecurity Fundamentals

• Agile Methodology

Experience Matrix

Skill

Required

Experience

Data Engineering (ETL & Data Quality)

Required

5+ Years

Python

Required

5+ Years

PyPI

Required

5+ Years

SQL

Required

5+ Years

Cybersecurity Principles

Required

5+ Years

Public Cloud Technologies

Required

5+ Years

Business Requirements Analysis

Required

5+ Years

Agile Development

Required

Preferred