Azure Databricks Engineer

Remote • Posted 4 hours ago • Updated 4 hours ago

Contract Independent

Contract W2

Contract Corp To Corp

Remote

Depends on Experience

GDH

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Summary

This position is a remote-based role for an experienced Azure/Databricks Engineer and Data Operations Engineer. The candidate will be responsible for designing, implementing, and managing enterprise data lake environments on Azure, focusing on automation, data pipeline development, and security compliance. The role requires a deep understanding of cloud data architecture and a commitment to enhancing data operations efficiency.

Responsibilities

Design, develop, and maintain scalable data pipelines for ETL/ELT processes using Azure Databricks, Data Factory, and Synapse.
Build and optimize data ingestion solutions utilizing Azure Event Hub, Kafka, or similar streaming services.
Manage enterprise data lake environments on Azure, ensuring data security, governance, and compliance using Unity Catalog, Collibra, and Azure IAM/RBAC.
Implement Infrastructure-as-Code (IaC) using Terraform and Bicep to automate environment provisioning and configurations.
Develop and deploy data workflows using PySpark, SQL, and Python, with version control through Git repositories.
Automate deployment processes and maintain CI/CD pipelines leveraging Azure DevOps or GitHub Actions.
Oversee data security processes, including network isolation with Private Link and VNet configurations.
Collaborate on Data Ops processes to improve automation, efficiency, and data quality across the organization.
Enable AI/ML solutions by integrating MLflow and managing feature stores for model tracking and deployment.
Ensure data environments meet regulatory standards and adhere to FinOps, audit, and compliance requirements.

Qualifications

Proven experience designing and managing data engineering solutions on Azure, including Databricks, Data Factory, Synapse, and ADLS Gen2.
Strong programming skills in PySpark, SQL, and Python for building data pipelines.
Hands-on experience with Infrastructure-as-Code (IaC), particularly Terraform and Bicep.
Familiarity with DevOps practices, CI/CD pipeline automation, and version control systems like Git.
Knowledge of data governance, security practices, and cloud compliance standards, especially in regulated industries such as healthcare or finance.
Experience with real-time data streaming and event ingestion platforms like Kafka or Event Hub.
Ability to work independently in a remote environment while collaborating effectively with cross-functional teams.
Strong understanding of data modeling, security, and scalable data architecture principles.
Excellent problem-solving skills and attention to detail, with an emphasis on automation and efficiency.
Availability to work full-time with flexible schedules aligning with project needs.

Publishing Pay Range: $70.00 - $75.00 Hourly

This is a fully remote role and can be performed from an approved location.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10112156
Position Id: 112038
Posted 4 hours ago

Company Info

About GDH

GDH is a technology workforce solutions provider committed to always giving and delivering more. Better talent. More client and consultant support. Greater service. World-class outcomes. Providing technology staffing, project solutions, and recruitment process outsourcing (RPO), we will be able to deepen our understanding of your business challenges, stay up to date with industry trends, and enhance our ability to create custom solutions to help achieve your business outcomes. We have established ourselves as a trusted partner to countless businesses operating in the communications sector. Our primary goal is to source and recruit the most talented professionals, assemble teams of skilled specialists, create innovative recruitment and professional services strategies that drive growth and foster innovation.

GDH Benefits

GDH offers a range of employee benefits that are designed to promote well-being and help maintain a healthy work-life balance. These comprehensive benefits cover various aspects of an employee's life and aim to enhance their overall experience with the company. Our health benefits include three medical insurance options with access to KISx Card, Zero Card, and HealthJoy concierge services. Other plan offerings include dental, vision, life, disability, supplemental insurance, and pet insurance plans. Enjoy additional perks like holiday pay, 401(k) plan, direct deposit, an employee referral program, work-life balance benefits, a Wellbeats membership, a discounted gym membership program, and more! For more detailed information on benefits, please go to GDH’s website under the tab for candidates.

GDH provides equal employment opportunities (EEO) to all employees and applicants for
employment without regard to race, color, religion, sex, national origin, age, disability, genetic information, veteran's status or any other category protected by law. In addition to federal law requirements, GDH Consulting, Inc. complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities and/or employees. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, benefits and training. Applicants with disabilities that require an accommodation or assistance in applying and/or for interviewing, please contact our HR Department.

Please visit GDH's website for notice of collection for California applicants.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.