Senior AWS Data Engineer

Role:                                     Senior AWS Data Engineer

Locations:                            Fort Mill, SC

Key Skills:                            Data Engineering, AWS, Airflow, Glue HVR

Mode of Hire:                       Full time

Job Description:

• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
• Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
• Implement data integration solutions using HVR to ensure real-time data availability.
• Write and optimize SQL queries for data retrieval and manipulation.
• Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Document data processes and maintain data quality standards.
• Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.

Mandatory Skills:

• Proven experience with AWS services, particularly Airflow and Glue.
• Strong knowledge of Snowflake and its data warehousing capabilities.
• Proficiency in SQL for data manipulation and analysis.
• Experience with Python for data processing and automation tasks.
• Hands-on experience with ETL processes and tools.
• Strong understanding of cloud computing concepts and architectures.

Preferred Skills:

• Experience with HVR for data replication and integration.
• Familiarity with data modelling and database design principles.
• Knowledge of data governance and data quality best practices.
• Experience with version control systems such as Git.
• Understanding of Agile methodologies and project management practices.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 7-12 years of experience in data engineering or a related role.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work independently and as part of a team in a fast-paced environment.