Senior Data Engineer – Databricks & AWS- 10+ yrs- Indianapolis, United States- Onsite
iMedhas Consulting Services
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Catalog
- Delta Lake
- Delta Live Tables (DLT)
- RBAC/ABAC
- and data-sharing controls.Data Engineering: Design and modernize ETL/ELT pipelines using PySpark
- Spark SQL
- Databricks Workflows
- and SQL Warehouses.Infrastructure & Automation: Integrate AWS core infrastructure (S3
- IAM
- Glue) with Infrastructure as Code (Terraform) and CI/CD automation
Summary
Job Requirements Senior Data Engineer:Migration Leadership: Lead end-to-end migration of data pipelines and databases from AWS Glue + PostgreSQL (Aurora) to Databricks Lakehouse.Platform & Governance: Implement enterprise standards for Unity Catalog, Delta Lake, Delta Live Tables (DLT), RBAC/ABAC, and data-sharing controls.Data Engineering: Design and modernize ETL/ELT pipelines using PySpark, Spark SQL, Databricks Workflows, and SQL Warehouses.Infrastructure & Automation: Integrate AWS core infrastructure (S3, IAM, Glue) with Infrastructure as Code (Terraform) and CI/CD automation.Work Experience 10-15Years
- Dice Id: 91143549
- Position Id: 5062-31204-1791471152
- Posted 11 hours ago
Company Info
Welcome to iMedhas Consulting Services. We are an IT consulting and services enterprises with precision expertise in Digital Transformations, Big data and Analytics. Through our expert team, we provide greater adaptabilities to disseminate with new technologies to increase the overall productivity, operational efficiency, and productivity of a particular business process of an organization.
The goal is the achievement of higher customer satisfaction and providing lucrative returns on investment to the business. On the other hand, we deliver content management expertise, ERP (SAP) systems integration, EAI, and Information Management services.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs