Data Engineer – Databricks - Full Time || 1776 Heritage Dr, Quincy, MA 02171 - Onsite
K&K Global Talent Solutions
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Databricks
- ETL
- Scala
- Azure
- Datawarehouse
Summary
Title : Data Engineer – Databricks - Full Time
Location : 1776 Heritage Dr, Quincy, MA 02171 - Onsite
Must Have Technical/Functional Skills
** Must be a local profile as its in person evaluation**
Must have at least 8+ years of extensive Data Engineering Experience in Databricks, ETL/ELT using Data pipelines, SQL/Procedure experience.
• Must have 8+ Years of hands-on development proficiency in implementing Databricks solutions using Scala and Spark with Data frames and Notebooks/SQL
• Must have 8+ Years of hands-on development and performance tuning/enhancement experience in Scala/PySpark and SQL.
• Must have 8+ Years of hands-on development experience in working on Azure Cloud.
• Must have strong experience with Databricks, including developing and optimizing Spark jobs, data transformations, and data processing workflows.
• Must have experience and a good understanding on the below topics
• Databricks Delta Lake storage
• Unity Catalog
• Autoloader
• Lakehouse Architecture
• Medallion Architecture
• Databricks Serverless Options.
• Dataset and Data frame
• Databricks Clusters Configuration and Sizing
• Databricks Job Orchestration
• Spark Structured Streaming
• Must have experience with complex and large volume data streaming and data transformations using Azure Databricks.
• Must have extensive experience in Datawarehouse/Data Lakehouse implementations.
• Must have experience with monitoring, debugging, and resolving issues in live Databricks jobs.
• Must have strong hands-on expertise in troubleshooting DevOps pipelines, Azure, and AKS services
• The candidate should be able to provide Data Ingestion, Streaming and Transformations solutions and do development work.
Pawan Kumar
(IT Recruiter)
E:
K&K Global Talent Solutions Inc.
7901 4th St N, St Petersburg, Florida 33702, US
US | Canada | Germany | India
- Dice Id: 91143240
- Position Id: 2091-30669-
- Posted 3 hours ago
Company Info
K&K Global Talents Solutions Inc: A New Era in the US Recruitment Industry With their partnership with a highly reputable German recruitment firm boasting over 30 years of experience, K&K Global Talents Solutions Inc. is an emerging player in the US recruitment industry. This collaboration allows them to merge the advantages of a new entrant with the vast knowledge and expertise of a well-established player. Clients and candidates are guaranteed to benefit from innovative recruitment approaches, cutting-edge strategies, and a wealth of knowledge and trust. K&K Global Talents represents the future of recruitment in both IT and Nursing industry, with a modern outlook and flexibility, combined with the methodologies that have sustained success for over 30 years, thanks to their esteemed German partner.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs