Overview
Skills
Job Details
EDI Data Engineer Position Summary
The Senior Data Engineer designs and leads scalable data architectures and pipelines to support analytics and business intelligence. This role focuses on data optimization, workflow automation, and ensuring reliable data operations in a cloud-based environment.
Minimum Qualifications
8+ years of IT experience, with 5+ years in:
Python, PySpark, and SQL for big data processing
Data lakes (Iceberg format), ETL (Informatica), and data quality
AWS services: S3, Glue, Redshift, Lambda, EMR, Airflow, Postgres
BASH/Shell scripting
Experience with healthcare data and leading data teams
Agile development experience
Strong problem-solving and communication skills
Responsibilities
Design and maintain scalable data pipelines and architectures
Lead data projects and ensure best practices
Collaborate across teams to meet data needs
Optimize data systems for analytics and reporting
Ensure data quality and system reliability in production environments