Data Engineer

Data Engineer Experience: 8+ years of relevant experience Location: Chicago, IL (Hybrid 3 days onsite per week)

What's in it for you?

Opportunity to work as a Strong Data Engineer with hands-on expertise in ETL development, Python, SQL, and practical experience with PySpark, Databricks, AWS, Terraform, Angular, and CI/CD tools.

Responsibilities:

• Design, develop, and maintain ETL pipelines using Python, PySpark, and SQL

• Perform large-scale data processing and transformation using Databricks

• Work with AWS services including S3, CloudWatch, IAM, SNS, and Lambda

• Use Terraform for infrastructure provisioning and management

• Support front-end integration tasks using Angular

• Collaborate on source control through Git and manage deployments using Octopus and Azure DevOps

• Basic exposure to Scala and HL7 standards is an added advantage

Educational Qualifications:

• Engineering degree: BE / ME / BTech / MTech / BSc / MSc

• Technical certifications across relevant technologies are preferred

Skills

Mandatory Skills:

• Strong hands-on experience in Python, PySpark, and SQL

• Front-end development experience with Angular

• Experience with AWS services: S3, CloudWatch, IAM, SNS, Lambda

• Working knowledge of Terraform

• Experience with Git, Octopus, and Azure DevOps for CI/CD processes

Good to Have Skills:

• Experience with PySpark, Databricks, AWS, Terraform, and Angular