Sr Data Engineer Lead/ Architect with Azure Databricks and Unity Catalog- Only W2 candidates will be considered. No C2C or third-party submissions.
Contract W2
10 Months
Travel Required
Able to Sponsor
On-site
$60 - $65/hr
Yashco Systems, Inc.
Fitment
Dice Job Match Score™
👤 Reviewing your profile...
Job Details
Skills
- ADF
- Data Engineering
- Databricks
- PySpark
- unity Catalog
- Unity
- Data Lake Storage (ADLS Gen2)
- Synapse
Summary
Role Overview:
We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in cloud data engineering, ETL development, and distributed data processing. The ideal candidate should have strong experience with Azure Databricks, PySpark, Delta Lake, Azure Data Factory, and building scalable data pipelines on Azure.
Key Skills Required:
- Strong hands-on experience with Azure Databricks (Notebooks, Jobs, Workflows, Delta Lake)
- Expertise in PySpark, Spark SQL, DataFrames, optimization, and debugging
- Experience with Azure Data Factory (ADF) pipelines, triggers, and integration runtime
- Strong knowledge of ADLS Gen2, data partitioning, and security
- Experience with SQL and writing optimized queries
- Hands-on experience with Git, CI/CD, and Azure DevOps pipelines
- Knowledge of Lakehouse architecture, Azure Synapse, Kafka/Event Hub is a plus
The role involves designing and optimizing enterprise-scale data pipelines, working with architects and business teams, and contributing to data engineering solutions using modern Azure technologies.
Yashco Systems, Inc. is an Equal Opportunity Employer M/F/V/D.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: RTL69726
- Position Id: 9005388
- Posted 2 hours ago
Company Info
About Yashco Systems, Inc.
Startup to Fortune 500 companies, Yashco Systems is one stop solution for all your software needs. A fast growing full service company, Yashco Systems offers IT Services Provider, Product Development Solutions and Business Process Outsourcing solutions to mid and large-sized organizations, IT Business Solution Company. We create innovative and cost effective solutions by first understanding how you work. We bring in the right people to get the job done. And we customize the delivery method to fit your business.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs