Senior Data Engineer

We are looking for Senior Data Engineer for our client in Fort Mill, SC.

Job Title: Senior Data Engineer

Job Location: Fort Mill, SC

Job Type: Contract

Job Overview:

Pay Range $60/hr - $65/hr

• We are seeking a skilled Sr Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes using AWS Glue.
• This role involves collaboration with data engineers, analysts, and other IT professionals to ensure efficient data integration and transformation for business use.

Requirement/Must Have:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience in data engineering roles with a focus on Snowflake, AWS services, Python, and DBT.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Technical certifications are a plus.
• 3 years of experience working with AWS Glue and other AWS data services.
• Proven experience in designing and maintaining ETL processes.
• Strong knowledge of SQL and database management.
• Familiarity with data warehousing concepts and tools.
• Experience with Python or other scripting languages.

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes using Snowflake, AWS services, Python, and DBT.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions.
• Optimize data workflows for performance, scalability, and reliability.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay updated on the latest technologies and best practices in data engineering.
• Design and implement scalable ETL solutions using AWS Glue.
• Collaborate with data engineers and analysts to understand data requirements.
• Develop and manage data extraction, transformation, and loading processes.
• Optimize and improve existing data pipelines and ETL workflows.
• Ensure data quality and integrity during the transformation process.
• Monitor and troubleshoot issues with ETL jobs.
• Maintain detailed documentation of data workflows and processes.
• Stay updated with the latest AWS services and tools.

Skills:

• Fivetran.
• HVR.
• AWS Glue.
• Lambda.
• Airflow.
• Snowflake.
• DBT.
• Python.