Databricks Python Developer

New York, NY, US • Posted 11 hours ago • Updated 11 hours ago
Full Time
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

  • Databricks
  • Python

Summary

Must Have Technical/Functional Skills

  • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
  • 5+ years of hands-on experience with Databricks, Python, and PySpark.
  • Strong hands-on experience in Databricks, Python, and PySpark development.
  • Experience building and supporting large-scale ETL/ELT data pipelines.
  • Strong knowledge of Spark SQL, Delta Lake, and Data Lakehouse architecture.
  • Experience working with structured and unstructured data from multiple sources.
  • Strong SQL skills and experience with relational databases.
  • Experience with data modeling, data transformation, and data quality processes.
  • Knowledge of orchestration tools such as Airflow, ADF, or similar.
  • Experience with Git, CI/CD, and Agile development methodologies.
  • Strong analytical, debugging, and performance tuning skills.
  • Excellent verbal and written communication skills.

Roles Responsibilities

  • Design, develop, and maintain data pipelines using Databricks, Python, and PySpark.
  • Build scalable data ingestion, transformation, and integration solutions.
  • Collaborate with Data Architects, Analysts, and business teams to deliver data solutions.
  • Develop and optimize batch and real-time data processing workflows.
  • Ensure data quality, integrity, security, and governance standards are met.
  • Monitor, troubleshoot, and resolve production data pipeline issues.
  • Optimize Spark jobs, SQL queries, and Databricks workloads for performance.
  • Participate in data modeling, code reviews, and platform enhancement activities.
  • Create technical documentation and support production deployments.
  • Participate in Agile ceremonies and contribute to continuous improvement initiatives.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91102852
  • Position Id: 9051224
  • Posted 11 hours ago
Contact the job poster
RC

Ramana Channamsetty

Recruiter @ DTEL Engineering & Consultants Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

New York, New York

7d ago

Easy Apply

Full-time

80000 - 115000

New York, New York

20d ago

Easy Apply

Contract

60 - 75

Jersey City, New Jersey

Today

Easy Apply

Contract

New York, New York

Today

Contract

USD 70.00 - 75.00 per hour

Search all similar jobs