Databricks Python Developer

Jersey City, NJ, US • Posted 4 hours ago • Updated 4 hours ago
Full Time
No Travel Required
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Pyspark
  • python
  • databricks
  • Delta Lake

Summary

K&K Global Talent Solutions Inc. is an international recruiting agency that has been providing technical resources in the Canada and the USA region since 1993.

This position is with one of our clients in USA, who is actively hiring candidates to expand their teams.

Job Title: Databricks Python Developer
Location: Jersey, City, NJ
Position type: Full time/Permanent role
Job Description
Databricks Python Developer
 
Must Have Technical/Functional Skills
• 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development.
• 5+ years of hands-on experience with Databricks, Python, and PySpark.
• Strong hands-on experience in Databricks, Python, and PySpark development.
• Experience building and supporting large-scale ETL/ELT data pipelines.
• Strong knowledge of Spark SQL, Delta Lake, and Data Lakehouse architecture.
• Experience working with structured and unstructured data from multiple sources.
• Strong SQL skills and experience with relational databases.
• Experience with data modeling, data transformation, and data quality processes.
• Knowledge of orchestration tools such as Airflow, ADF, or similar.
• Experience with Git, CI/CD, and Agile development methodologies.
• Strong analytical, debugging, and performance tuning skills.
• Excellent verbal and written communication skills.
 
Roles  Responsibilities
• Design, develop, and maintain data pipelines using Databricks, Python, and PySpark.
• Build scalable data ingestion, transformation, and integration solutions.
• Collaborate with Data Architects, Analysts, and business teams to deliver data solutions.
• Develop and optimize batch and real-time data processing workflows.
• Ensure data quality, integrity, security, and governance standards are met.
• Monitor, troubleshoot, and resolve production data pipeline issues.
• Optimize Spark jobs, SQL queries, and Databricks workloads for performance.
• Participate in data modeling, code reviews, and platform enhancement activities.
• Create technical documentation and support production deployments.
• Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91143240
  • Position Id: 2999-30669-1792014639
  • Posted 4 hours ago

Company Info

About K&K Global Talent Solutions

K&K Global Talents Solutions Inc: A New Era in the US Recruitment Industry With their partnership with a highly reputable German recruitment firm boasting over 30 years of experience, K&K Global Talents Solutions Inc. is an emerging player in the US recruitment industry. This collaboration allows them to merge the advantages of a new entrant with the vast knowledge and expertise of a well-established player. Clients and candidates are guaranteed to benefit from innovative recruitment approaches, cutting-edge strategies, and a wealth of knowledge and trust. K&K Global Talents represents the future of recruitment in both IT and Nursing industry, with a modern outlook and flexibility, combined with the methodologies that have sustained success for over 30 years, thanks to their esteemed German partner.

About_Company_OneAbout_Company_Two
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.