Overview
Remote
$DOE
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - Long Term
Skills
CI/CD
Apache
Data Lake
Databricks
Job Details
Title: Data Engineer Databricks & Analytics
Location: Remote
Experience: Mid-Level position
Duration: Long term
Job Summary
We are seeking a Data Engineer with deep expertise in Databricks and analytics to lead the design and implementation of scalable, high-performance data solutions. This role will partner closely with analytics, data science, and business teams to drive enterprise-level data initiatives and mentor junior engineers.
Key Responsibilities
- Lead the design, development, and optimization of enterprise-scale data pipelines using Databricks
- Architect and maintain ETL/ELT frameworks for large and complex datasets
- Develop and enforce data engineering best practices, standards, and governance
- Optimize performance of Spark jobs and Databricks workloads
- Design and manage analytics-ready data models for reporting and advanced analytics
- Collaborate with stakeholders to define data strategy and technical roadmaps
- Mentor and provide technical guidance to junior and mid-level data engineers
- Ensure data quality, reliability, security, and compliance
- Support advanced analytics, machine learning, and BI use cases
- Troubleshoot complex data and performance issues across environments
- Participate in code reviews and architecture discussions
Required Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience)
- 10+ years of experience in data engineering or analytics engineering
- 4+ years of hands-on experience with Databricks
- Strong expertise in Apache Spark, SQL, and Python
- Experience designing scalable data architectures
- Proficiency with cloud platforms (AWS, Azure, or Google Cloud Platform)
- Strong experience with data warehousing and lakehouse architectures
- Knowledge of data modeling for analytics (star, snowflake schemas)
Preferred Qualifications:
- Databricks Certified Data Engineer (Associate or Professional)
- Hands-on experience with Data Lake and Lakehouse architecture
- Experience with real-time or streaming data pipelines
- Familiarity with BI tools (Power BI, Tableau, Looker)
- Experience implementing CI/CD for data pipelines
- Experience working in Agile/Scrum environments
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.