Databricks Engineer

Phoenix, AZ, US • Posted 1 hour ago • Updated 1 hour ago
Full Time
On-site
USD $50.00 - 52.00 per hour
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Regulatory Compliance
  • JD
  • Optimization
  • Data Engineering
  • Real-time
  • Analytical Skill
  • Use Cases
  • Extract
  • Transform
  • Load
  • ELT
  • Data Modeling
  • Dimensional Modeling
  • Data Warehouse
  • Data Loading
  • Meta-data Management
  • Data Quality
  • Management
  • Unity
  • Access Control
  • Workflow
  • Orchestration
  • Apache Airflow
  • Continuous Integration
  • Continuous Delivery
  • DevOps
  • IT Management
  • Databricks
  • Cloud Computing
  • Storage
  • Apache Spark
  • Streaming
  • Data Processing
  • Python
  • PySpark
  • Scala
  • SQL

Summary

Visa not allowed.
  • CPT EAD
  • Stem - OPT
  • OPT EAD
  • FTE to Subco conversion - 6 months cooling period we need to follow or get approval.

  • Atos has stringent compliance and security requirements that all employees are expected to adhere to.
  • Inform the candidate that they must not have any other part-time or full-time employment while working with Atos on this assignment.
  • Obtain explicit confirmation from the candidate that they understand and are comfortable with these requirements and the expected work arrangement before proceeding further.

Client Name - AMEX

Glow - 3ET0JY

Posman - 134667

Role / Skills - Databricks Engineer

Rate - USD $52

Location - Pheonix - Day 1 Onsite - min 3 days a week.

JD - Confirm / share us the complete JD and lets us know if anything specific:

Databricks Engineer

Role Overview

We are seeking a highly skilled Databricks Engineer to lead the design, implementation, and optimization of scalable cloud-based data platforms. This role requires deep expertise in Lakehouse architecture, Databricks, Apache Spark, and Delta Lake, along with proven experience delivering end-to-end enterprise data engineering solutions.

Key Responsibilities
  • Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions.
  • Lead implementation of:
  • Cloud-based data lakehouse platforms integrating diverse data sources.
  • Real-time data processing pipelines for operational and analytical use cases.
  • Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL.
  • Implement advanced data modeling solutions including 3NF, dimensional modeling, and enterprise data warehousing strategies.
  • Design and build incremental data loading frameworks and metadata-driven ingestion pipelines.
  • Establish data quality frameworks and governance standards.
  • Implement and manage Unity Catalog, including fine-grained security and access controls.
  • Leverage Databricks components such as:
  • Delta Live Tables
  • Autoloader
  • Structured Streaming
  • Databricks Workflows
  • Integration with orchestration tools (e.g., Apache Airflow)
  • Drive CI/CD automation, deployment strategies, and DevOps best practices.
  • Optimize performance of pipelines, Spark jobs, and compute resources.
  • Provide architectural guidance and technical leadership across cross-functional teams.
  • Engage with stakeholders and clients to translate business requirements into scalable technical solutions.

Deep expertise in:
  • Databricks and cloud-native storage/compute platforms
  • Apache Spark (batch & streaming)
  • Delta Lake & Lakehouse architecture
  • Distributed data processing systems
  • Strong hands-on programming skills in Python, PySpark, Scala, and SQL.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX1d6413
  • Position Id: 540f25a88ee06e2f0d5d2b0c6d0bdd31
  • Posted 1 hour ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.