Location: EDEN PRAIRIE, MN
Competencies: Digital : Databricks - 6-8+ years experience
Must Have:
8+ years of experience in data engineering with Databricks and Spark
Strong knowledge of Databricks architecture, tools and capabilities
Experience in Design, develop, and optimize ETL/ELT data pipelines using Databricks on AWS.
Good understanding of AWS native services S3, DataSync, DMS, Lambda, SNS, SQS.
SQL and PySpark : strong command over querying databases and proficiency in PySpark.
Experience with Delta Lake and building data lakes.
Familiarity with CI/CD pipelines using tools such as Gitlab.
Good communication and presentation skills
Agile trained and knowledge of JIRA
Good to Have:
Databricks Certified
Knowledge in On-Prem(Teradata, SQL Server etc.) and Cloud Data Platforms(RDS, Redshift etc.)
Knowledge in Data Warehousing concepts
Knowledge in AWS cloud
Experience in Retail & Supply Chain domain
Responsibility of / Expectations from the Role
Work as a Technical lead for medium to large complex project/feature enhancements
Accountable for the design and development
Work with the Product Management team, Project Management, Business and User Experience teams
to identify and prioritize initiatives and features
Participate in all grooming and priority setting sessions and accountable for project sizing and estimation
Work closely with other development teams across organization to troubleshoot issues, performance
tuning and identify opportunities for seamless integrations across systems
Works closely with the Production Support team to train, guide and troubleshoot production issues
Provides coaching and technical guidance for Software Engineers at different levels of experience
Additional Sills:
| Skills: | | Category | Name | Required | Importance | Experience | | SkillCategoryTest1_MN | Digital : Azure Databricks | Yes | 1 | 4-7 years | | |
Never miss an opportunity! Create an alert based on the job you applied for.
