Lead Databricks Developer/Big Data Engineer

Austin, TX, US • Posted 4 days ago • Updated 6 hours ago

Contract Independent

On-site

USD $55.00 - 57.00 per hour

Judge Group, Inc.

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

Big Data
Extract
Transform
Load
ELT
Workflow
Continuous Integration
Continuous Delivery
Collaboration
Data Modeling
Data Lake
Storage
Data Warehouse
Data Validation
Data Security
Encryption
Access Control
Auditing
Python
R
Data Manipulation
Cloud Computing
DevOps
Version Control
Agile
Debugging
SQL
Machine Learning (ML)
scikit-learn
TensorFlow
Databricks
Apache Spark
Microsoft Azure
Privacy
Marketing

Summary

Location: Austin, TX
Salary: $55.00 USD Hourly - $57.00 USD Hourly
Description:

Position: Lead Databricks Developer/ Dig Data Engineer

Location: Fully Remote but must be located in Austin, TX

Duration: 6+ month
Minimum Qualifications

8+ years of experience in ETL/ELT workflows, CI/CD automation, and cross-functional collaboration.
Strong expertise in data modeling, data lakes (Azure Data Lake Storage), and data warehouses.
Proven ability to implement data validation, governance, lineage, and cataloging.
Hands-on experience with data security measures including encryption, access controls, and auditing.
Proficiency in Python, R, and SQL for data manipulation and analysis.
Solid experience with the Azure cloud platform, DevOps practices, and version control systems.
Background in Agile environments, with strong troubleshooting and debugging skills.
5+ years of experience designing pipelines and optimizing Spark jobs on Databricks.
Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake.

Preferred Qualifications

Knowledge of ML libraries such as MLflow, Scikit-learn, or TensorFlow.
Databricks Certified Associate Developer for Apache Spark.
Azure Data Engineer Associate certification.

Thanks & Regards.

Prakash Dwivedi

E: I

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: cxjudgpa
Position Id: 1114212
Posted 4 days ago

Company Info

About Judge Group, Inc.

The Judge Group, is a leading professional services firm specializing in talent, technology, and learning solutions. We consult, staff, train, and solve. Through our work we make people and organizations better.

Our services are successfully delivered through a network of more than 30 offices across the United States, Canada, and India. The Judge Group is proud to partner with the best and brightest companies in business today, including over 60 of the Fortune 100. We serve organizations in financial services, healthcare, life sciences, insurance, government (including aerospace and defense), manufacturing, and technology and telecommunications.

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.