Search Jobs | Dice.com

1 results (1 new)

Group by company

Azure Databricks Engineer (Pyspark) ADLS Gen2

Logicplanet, Inc.

Hybrid in Plano, Texas • Today

Easy Apply

Third Party, Contract

50 - 60

Job Details

Skills

ADLS Gen2
DataBricks
Pyspark
DLT
ETL
Azure
Oracle
Python

Summary

Hi,

We have an urgent job opening for Azure Databricks Engineer (Pyspark) ADLS Gen2______ Plano, Texas (Onsite) Face to face interview Required Please send the updated resume if you find comfortable for this position.
Job Title:- Azure Databricks Engineer (Pyspark) ADLS Gen2

Location: Plano, Texas (Onsite)

Duration:- Long Term Contract

Face to face Interview Required

Job Description:-

Role Summary

We are seeking a Tech Lead to drive the end-to-end successful migration of enterprise data integration workloads from Informatica to Azure Databricks and to provide thought leadership for the Databricks platform within the supply chain ecosystem. This role combines hands on technical leadership, architecture guidance, delivery ownership, stakeholder alignment, and platform enablement. The ideal candidate will lead modernization efforts that improve scalability, reliability, performance, and business value across supply chain data products and analytics capabilities.

Key Responsibilities

Lead the end-to-end migration of data pipelines, workflows, and integration patterns from Informatica to Azure Databricks.
Assess current state Informatica assets and define target state architecture, migration strategy, and phased execution plans. The current environment is based on Informatica PowerCenter 10.4.1 running batch ETL workloads, with Oracle as both the source and target database. The target state platform is Azure Databricks (Runtime 14.4 LTS) with Unity Catalog, Delta Live Tables (DLT), and ADLS Gen2.
Drive modernization of ETL patterns into scalable ELT and data engineering approaches aligned with Azure Databricks best practices.
Analyze and interpret complex Informatica PowerCenter mappings, including transformations, lookups, joins, filters, routers, and expression logic, and build equivalent PySpark based pipelines in Azure Databricks.
Assess Oracle database level stored procedures, functions, and packages that are invoked by or tightly coupled with Informatica workflows, and determine whether to migrate, refactor, or recreate that logic within Databricks using PySpark, Python, or Spark SQL.
Provide technical leadership across solution design, engineering standards, code quality, testing strategy, deployment, and production readiness.
Partner with business, product, architecture, infrastructure, security, and operations stakeholders to align migration outcomes with enterprise priorities.
Establish migration success criteria covering data quality, reconciliation, performance, resilience, observability, and business continuity.
Identify delivery risks, dependencies, and technical constraints early, and drive mitigation plans through execution.
Guide cutover, stabilization, and post migration optimization to ensure sustainable platform adoption and operational excellence.
Mentor engineers and technical teams on Databricks design patterns, reusable frameworks, and modern data engineering practices

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10111282
Position Id: 9129049
Posted 2 hours ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Contact the job poster

Prithvi Tammareddy

Recruiter @ Logicplanet, Inc.

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Databricks Engineer

Plano, Texas

•

Today

job summary: - We are seeking a Senior Databricks Engineer to join our Data Engineering team and support our enterprise data modernization initiatives. This role will work closely with Application Leads, Data Engineers, Architects, and business stakeholders to design, implement, optimize, and govern solutions on the Databricks Lakehouse Platform. - The ideal candidate will be a hands-on Databricks SME who can guide teams on implementation best practices, governance, security, performance optim

Contract

USD56 - USD66

Senior Databricks Engineer

Hybrid in Plano, Texas

•

8d ago

This Senior Databricks Engineer job is a 12-24 Months Contract with a client located in Plano, TX/ Charlotte, NC (Hybrid 4 Days onsite every week). Job Description We are seeking a Senior Databricks Engineer to join our Data Engineering team and support our enterprise data modernization initiatives. This role will work closely with Application Leads, Data Engineers, Architects, and business stakeholders to design, implement, optimize, and govern solutions on the Databricks Lakehouse Platform.

Easy Apply

Third Party, Contract

$68 - $70

Senior Azure Data Engineer

Plano, Texas

•

2d ago

Senior Azure Data Engineer (Azure Databricks) Direct Hire Plano, TX (Hybrid) Overview We re partnering with a confidential, enterprise-scale organization to hire a Senior Azure Data Engineer with deep expertise in Azure Databricks to help design, build, and optimize a modern lakehouse data platform. You ll develop scalable ETL/ELT pipelines, implement Medallion (Bronze/Silver/Gold) patterns, and enable advanced analytics in a high-volume environment. This role collaborates closely with data arc

Easy Apply

Full-time

USD150000 per annum

Senior Azure Data Engineer

Plano, Texas

•

Today

Easy Apply

Full-time

USD150000 per annum

Job Details

Skills

ADLS Gen2
DataBricks
Pyspark
DLT
ETL
Azure
Oracle
Python

Summary

Hi,

Location: Plano, Texas (Onsite)

Duration:- Long Term Contract

Face to face Interview Required

Job Description:-

Role Summary

Key Responsibilities

Lead the end-to-end migration of data pipelines, workflows, and integration patterns from Informatica to Azure Databricks.
Assess current state Informatica assets and define target state architecture, migration strategy, and phased execution plans. The current environment is based on Informatica PowerCenter 10.4.1 running batch ETL workloads, with Oracle as both the source and target database. The target state platform is Azure Databricks (Runtime 14.4 LTS) with Unity Catalog, Delta Live Tables (DLT), and ADLS Gen2.
Drive modernization of ETL patterns into scalable ELT and data engineering approaches aligned with Azure Databricks best practices.
Analyze and interpret complex Informatica PowerCenter mappings, including transformations, lookups, joins, filters, routers, and expression logic, and build equivalent PySpark based pipelines in Azure Databricks.
Assess Oracle database level stored procedures, functions, and packages that are invoked by or tightly coupled with Informatica workflows, and determine whether to migrate, refactor, or recreate that logic within Databricks using PySpark, Python, or Spark SQL.
Provide technical leadership across solution design, engineering standards, code quality, testing strategy, deployment, and production readiness.
Partner with business, product, architecture, infrastructure, security, and operations stakeholders to align migration outcomes with enterprise priorities.
Establish migration success criteria covering data quality, reconciliation, performance, resilience, observability, and business continuity.
Identify delivery risks, dependencies, and technical constraints early, and drive mitigation plans through execution.
Guide cutover, stabilization, and post migration optimization to ensure sustainable platform adoption and operational excellence.
Mentor engineers and technical teams on Databricks design patterns, reusable frameworks, and modern data engineering practices

Dice Id: 10111282
Position Id: 9129049
Posted 2 hours ago

Fitment