Senior Data Engineer

Job Title: Senior Data Engineer

Job Location: Raleigh, NC

Job Type: Contract

Job Overview:

Requirement/Must Have:

• Demonstrated mid-level to senior-level experience in data engineering with a strong emphasis on data quality assurance and ETL processes.
• Expertise in Python, PyPI, and SQL.
• Strong experience designing, developing, and optimizing ETL workflows.
• Experience working with Amazon S3 and Snowflake data platforms.
• Strong understanding of data quality management, validation, and quality assurance processes.
• Expert analytical and problem-solving skills.
• Strong understanding of cybersecurity principles related to code development, DevOps, data access, and foundational security practices.
• Understanding of fundamental public cloud capabilities.
• Ability to translate business needs into technical requirements.
• Strong communication and collaboration skills.
• Experience working in Agile environments with the ability to define success, deliver, and operate effectively.

Experience:

• Experience supporting data consumed by downstream applications and reporting systems.
• Experience resolving source data inconsistencies that impact ingestion, load failures, or data backouts.
• Experience monitoring data pipelines and troubleshooting end-to-end data flow issues.

Responsibilities:

• Implement and maintain data quality processes to ensure the accuracy and reliability of data throughout the ETL lifecycle.
• Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
• Ensure seamless data integration into the data platform for efficient consumption by downstream applications and reporting tools.
• Address data quality issues, including inconsistencies in source data that do not meet ingestion requirements and may cause load failures or data backouts.
• Collaborate closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand requirements and deliver high-quality data solutions.
• Monitor data pipelines to preserve data flow and integrity.
• Identify pipeline or data issues and implement effective solutions.
• Support critical business processes by ensuring accurate, reliable, and timely data delivery.

Should Have:

• Strong focus on data integrity and operational reliability.
• Ability to work cross-functionally with technical and business stakeholders.
• Experience with cloud-based data engineering workflows.
• Strong ownership mindset in production support and delivery.

Skills:

• Data engineering.
• ETL development.
• Data quality assurance.
• Data validation.
• Python.
• PyPI.
• SQL.
• Amazon S3.
• Snowflake.
• Data integration.
• Pipeline monitoring.
• Troubleshooting.
• Public cloud fundamentals.
• Cybersecurity awareness.
• Agile delivery.

Qualification and Education:

• Bachelor s degree in Computer Science, Information Systems, Engineering, or a related field preferred.