Overview
Skills
Job Details
Job Responsibilities:
Design and Develop Data Pipelines: Create and maintain scalable and efficient data pipelines to integrate data from EEH systems, Data Lake, and Application APIs.
Cloud-Based Development: Utilize AWS services (e.g., S3, Redshift, Glue, Lambda) to build and manage data infrastructure in the cloud.
Data Integration: Ensure seamless data flow and integration across various systems and platforms.
API Development: Develop and maintain APIs to facilitate data access and integration with other applications.
Data Management: Implement best practices for data management, including data quality, governance, and security.
Performance Optimization: Optimize data processing workflows for performance and scalability.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Leadership: Mentor junior data engineers and lead data engineering projects to successful completion.
Qualifications:
Education: Bachelor's degree in Computer Science, Engineering, or a related technical field.
Experience: Minimum of 5 to 8 years of experience in data engineering or related roles, with a focus on cloud-based environments.
Technical Skills:
Proficiency in AWS services (e.g., S3, Redshift, Glue, Lambda).
Strong programming skills in Python, Java, or Scala.
Experience with ETL processes and tools.
Familiarity with data integration and API development.
Soft Skills:
Strong problem-solving abilities and analytical skills.
Excellent communication skills and the ability to work collaboratively in a team environment.
Leadership and mentorship capabilities.