Data Engineering with Databricks Database

Hi,
Hope doing well!!
Below is the job description, if you are looking for a new role please revert me with updated resume.

Role: Data Engineering with Databricks Database
Location: Boston, MA (Onsite)(Only Local)
Duration: FTE
Job Opportunity:

• This opportunity for an experienced Databricks Database Engineer to join their Boston based Technology team.
• This position will spearhead our data engineering initiatives, focusing on designing, building, and optimizing scalable data solutions using Databricks.
• The ability to work both independently and within a dynamic team environment is crucial.
• You will mentor a team of data engineers, collaborate with cross-functional stakeholders, and define best practices to unlock the full potential of our data.

Duties & Responsibilities:

• Mentor a team of data engineers in implementing Databricks-based solutions.
• Define and drive the data engineering strategy, ensuring alignment with business goals.
• Design and develop scalable data pipelines and ETL processes using Databricks.
• Optimize and tune Spark jobs for performance and efficiency.
• Recommend best practices for Databricks cluster management and data security.
• Build and maintain robust data models to support analytics and reporting needs.
• Integrate Databricks with various data sources (cloud storage, databases, APIs).
• Implement Delta Lake for reliable, scalable, and performant data lakes.
• Work closely with data analysts and stakeholders to deliver actionable insights.
• Act as the technical liaison between the data engineering team and other stakeholders.
• Stay updated on the latest Databricks and Azure features to drive continuous improvements.
• Automate repetitive processes and streamline data workflows.

Qualifications, Skills and Experience:

• Minimum 10+ years industry experience.
• Proven experience (3+ years) in data engineering on Databricks, including Spark, and Delta Lake.
• Proficiency in Python, SQL, in a Microsoft Azure Environment.
• Hands-on experience with data lakes, data warehouses, and big data technologies.
• Excellent problem-solving and communication skills with the ability to interface with teammates at all levels.
• Ability to estimate work and strive to meet agreed timelines.
• Aptitude for working both individually and as part of a team.
• Prior insurance industry experience is a strong plus.

If I miss your call, Email is the best way to reach me
Thanks & Regards
Amit Tiwari
Sr. Technical Recruiter
Desk : Ext- 2142
Nityo Infotech Corp.
666 Plainsboro Road, Suite 1285, Plainsboro, NJ 08536