Overview
On Site
USD 55.00 - 57.00 per hour
Contract - Independent
Skills
Big Data
Extract
Transform
Load
ELT
Workflow
Continuous Integration
Continuous Delivery
Collaboration
Data Modeling
Data Lake
Storage
Data Warehouse
Data Validation
Data Security
Encryption
Access Control
Auditing
Python
R
Data Manipulation
Cloud Computing
DevOps
Version Control
Agile
Debugging
SQL
Machine Learning (ML)
scikit-learn
TensorFlow
Databricks
Apache Spark
Microsoft Azure
Privacy
Marketing
Job Details
Location: Austin, TX
Salary: $55.00 USD Hourly - $57.00 USD Hourly
Description:
Position: Lead Databricks Developer/ Dig Data Engineer
Location: Fully Remote but must be located in Austin, TX
Duration: 6+ month
Minimum Qualifications
Thanks & Regards.
Prakash Dwivedi
E: I
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Salary: $55.00 USD Hourly - $57.00 USD Hourly
Description:
Position: Lead Databricks Developer/ Dig Data Engineer
Location: Fully Remote but must be located in Austin, TX
Duration: 6+ month
Minimum Qualifications
- 8+ years of experience in ETL/ELT workflows, CI/CD automation, and cross-functional collaboration.
- Strong expertise in data modeling, data lakes (Azure Data Lake Storage), and data warehouses.
- Proven ability to implement data validation, governance, lineage, and cataloging.
- Hands-on experience with data security measures including encryption, access controls, and auditing.
- Proficiency in Python, R, and SQL for data manipulation and analysis.
- Solid experience with the Azure cloud platform, DevOps practices, and version control systems.
- Background in Agile environments, with strong troubleshooting and debugging skills.
- 5+ years of experience designing pipelines and optimizing Spark jobs on Databricks.
- Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
- Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake.
- Knowledge of ML libraries such as MLflow, Scikit-learn, or TensorFlow.
- Databricks Certified Associate Developer for Apache Spark.
- Azure Data Engineer Associate certification.
Thanks & Regards.
Prakash Dwivedi
E: I
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.