Databricks Engineer

Boston, MA, US • Posted 10 hours ago • Updated 10 hours ago

Contract W2

On-site

Depends on Experience

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

Spark
Scala
Databricks
Apache Hadoop
Amazon Web Services
Docker

Summary

Skill Sets Required

Good decision-making and problem-solving skills
Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
Knowledge on medallion architecture, DLT and unity catalog within Databricks.
Experience in migrating data from on-prem Hadoop to Databricks/AWS
Understanding of core AWS services, uses, and AWS architecture best practices
Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
Solid knowledge on Airflow
Solid knowledge on CI/CD pipeline in AWS technologies
Application migration of RDBMS, java/python applications, model code, elastic etc.
Solid programming background on scala, python
Experience with Docker and Kubernetes is a plus

Education and experience Qualification

Bachelor s degree in computer science, Information Systems, or equivalent education or work experience
Around 5+ years of experience as a developer on cloud technologies
Any AWS and/or Databricks certification will be a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10426916
Position Id: 8927130
Posted 10 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Databricks Engineer local in MA

Hybrid in Quincy, Massachusetts

•

4d ago

hands-on on Data Engineering, AWS resources. Candidates should have end-to-end to knowledge of application migration and should suggest cloud services which can replace existing on-premises services. In a nutshell we are looking for candidates who have hands on experience with migration of legacy applications from On-prem to AWS Public Cloud using AWS services such as EC2, ALB/ELB, S3, FSX, Opensearch, Kibana, CloudWatch, grafana, AWS Secret Manager with CyberArk, KMS and OIDC/ SAML integration

Easy Apply

Third Party, Contract

Depends on Experience

Data Engineer (Databricks)

Boston, Massachusetts

•

Today

Role:Data Engineer (Databricks) Location:Boston, MA (Day One Onsite) Fulltime Key Responsibilities Design, develop, and optimize ETL/ELT pipelines in Databricks.Implement real-time and batch data processing solutions using Apache Spark and Delta Lake.Develop PySpark/Scala-based data transformation scripts for large-scale data processing.Ensure data quality, performance tuning, and cost optimization within Databricks.Implement CI/CD pipelines for Databricks workflows using Terraform, GitHub Actio

Easy Apply

Full-time

Depends on Experience

W2 Role: Sr. Databricks Engineer (with Validation/Testing experience)

Remote

•

3d ago

Hello, Visa. Independent candidate - Need to work on W2 Role: Sr. Databricks Engineer (with Validation/Testing experience) Location: 100% Remote Duration: Long Term Contract Key Requirements Deep Databricks expertise (developer level), not just exposure Strong hands on experience with Databricks Medallion Architecture o Bronze / Silver / Gold (also referred to as Raw / Silver / Mark layers internally) o Experience validating and testing data as it moves across layers Experience ingesting data f

Easy Apply

Contract

Depends on Experience

Databricks Engineer (Scala Spark)

Hybrid in Boston, Massachusetts

•

Today

Job Title: Databricks Engineer (Scala Spark) Location: Boston, MA (Hybrid Onsite) Type: W2 (Locals Preferred) Roles & Responsibilities Recognize the current application infrastructure and suggest new concepts to improve performanceDocument the best practices and strategies associated with application deployment and infrastructure supportProduce reusable, efficient, and scalable programs, and also cost-effective migration strategiesDevelop Data Engineering and ML pipelines in Databricks and dif

Easy Apply

Contract, Third Party

$60 - $70

Search all similar jobs