Apply Now

Databricks Lead Engineer

Remote • Posted 30+ days ago • Updated 1 day ago

Contract Corp To Corp

Contract Independent

Contract W2

Occasional Travel Required

Remote

Depends on Experience

Allwyn Corporation

Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

Amazon Web Services
Data Processing
Data Engineering
Databricks
PySpark
Business Intelligence
Advanced Analytics
Apache Kafka
Meta-data Management
Data Masking
Leadership
SQL
Cloud Computing

Summary

Architecture & Design

Define and design end-to-end data lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native services.
Create reference architectures for batch, real-time, and streaming data pipelines.
Architect data ingestion, curation, storage, and governance frameworks.
Ensure the platform is scalable, secure, and optimized for performance and cost.
Establish standards for data lineage, metadata management, and compliance.
Work with enterprise architects to align Databricks solutions with overall cloud strategy (AWS).

Leadership & Delivery:

Lead and mentor a team of data engineers in building robust data pipelines.
Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases.
Drive adoption of DevOps and CI/CD practices for data engineering.
Review designs and solutions to ensure adherence to architectural principles.

Implementation & Optimization

Build, optimize, and manage large-scale PySpark/SQL pipelines in Databricks.
Enable real-time data processing through Kafka, Kinesis, or Event Hubs.
Implement security best practices including RBAC, data masking, and encryption

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10194781
Position Id: 8912050
Posted 30+ days ago

Company Info

About Allwyn Corporation

We are driven by a passion for innovation and a commitment to delivering real results for our clients. At Allwyn Corporation, we strive to be a trusted partner for businesses looking to thrive in today's fast-paced and competitive digital landscape.

Company Culture

We are committed to providing our employees with opportunities for growth and development, both personally and professionally. We offer competitive compensation packages, comprehensive benefits, and a range of perks and incentives designed to promote work-life balance and employee wellness.

If you are passionate about using technology to drive positive change in the world and are looking for a dynamic and supportive work environment, we encourage you to explore our current job openings and apply to join our team. We look forward to hearing from you!

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Databricks Lead/Architecture (AWS)

Remote

•

Yesterday

Required Skills: Leadership & DeliveryLead and mentor a team of data engineers in building robust data pipelines.Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases.Drive adoption of DevOps and CI/CD practicesfor data engineering.Review designs and solutions to ensure adherence to architectural principles.Implementation & OptimizationBuild, optimize, and manage large-scale PySpark/SQL pipelinesin Databricks.Enable real-time data

Easy Apply

Contract, Third Party

90 - 95

Search all similar jobs