Title : Senior /lead Data Engineer
Location : Eagan, MN(Need locals only)
Duration : 3-6 months
Rate : $ Open
Relevant Experience: 10+ Years
Job Description
- What are they looking for:
- Dev Engineer capabilities (this is the core of the role)
- App dev experience (scripting, especially in python)
- Expert in AI or Automation (this would be a huge plus)
- NOTE: they understand this might be a unicorn, so these are listed in priority with 2 and 3 being bonuses
Skills
Proficient in data manipulation and pipeline development
Experience processing large datasets in a distributed environment
Hands-on experience with Databricks notebooks, workflows, and cluster management
Moderate hands-on experience with S3, Lambda, Glue, and EC2
Experience scheduling and automating pipelines
Strong SQL skills for complex data extraction and transformation queries
Comfortable with version control in a collaborative, shared-repo environment
Comfortable creating and managing issues and epics
Summary
Modernize data pipeline from SAS to Python/PySpark on Databricks.
o This Data Engineer will own and evolve our critical HEDIS data pipeline.
HEDIS data is delivered to our analytics vendor and used to measure BCBS s performance across key dimensions of care.
o This role will initially partner with SMEs during a knowledge transfer period. They will eventually take on pipeline ownership.
Regards,
Shanthi Pedhiredla
SOVEREIGN TECHNOLOGIES LLC
Certified Minority Owned Business ( MBE)
Never miss an opportunity! Create an alert based on the job you applied for.
