Databricks Data Engineer -- W2 Profiles -- Hybrid

Hybrid in Boston, MA, US β€’ Posted 7 hours ago β€’ Updated 7 hours ago
Contract W2
2 Years
No Travel Required
Able to Sponsor
Hybrid
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Scoreβ„’

πŸ”’ Crunching numbers...

Job Details

Skills

  • Amazon Web Services
  • Workflow Management
  • Data Governance
  • Data Processing
  • Continuous Improvement
  • Apache Spark
  • Production Support
  • Query Optimization
  • Mergers and Acquisitions
  • Databricks
  • Collaboration
  • Scalability
  • SQL

Summary

*Senior Databricks Engineer*
Location: Boston, MA – Hybrid (locals preferred)


Key Responsibilities
Design, develop, and maintain scalable data ingestion pipelines, ETL workflows, and data processing jobs using Databricks and Apache Spark.
Develop and optimize Spark applications using Scala and PySpark.
Build robust data pipelines to ingest, transform, validate, and process structured and semi-structured data.
Write complex SQL queries for data transformation, validation, reconciliation, and performance optimization.
Configure and manage Databricks workspaces, clusters, jobs, and workflow scheduling.
Develop, schedule, monitor, and troubleshoot Databricks jobs and workflows.
Optimize Spark jobs and data pipelines for performance, scalability, reliability, and cost efficiency.
Integrate Databricks-based data solutions with AWS services and cloud-based data platforms.
Implement data quality checks, error handling, logging, and monitoring for production pipelines.
Troubleshoot pipeline failures, performance bottlenecks, and data processing issues.
Collaborate with data architects, analysts, engineers, and other stakeholders to translate business requirements into technical solutions.
Follow established coding standards, engineering best practices, and data governance requirements.
Support production deployments, maintenance, and continuous improvement of data engineering solutions.

Required Skills and Qualifications
9 years of overall experience in Scala/Spark data engineering and data pipeline design.
Strong hands-on experience with Scala and Apache Spark programming.
Strong SQL skills, including complex queries, joins, aggregations, and query optimization.
Hands-on experience designing and developing data ingestion pipelines, ETL pipelines, and data processing jobs.
Experience with AWS services and cloud-based data engineering solutions.
Strong understanding of distributed data processing, data transformations, and pipeline architecture.
Experience troubleshooting and optimizing Spark applications and data workflows.
Strong analytical, problem-solving, and communication skills.
Ability to participate in technical coding assessments and explain implementation decisions.

Preferred Skills
Hands-on experience with Databricks.
Experience configuring and managing Databricks workspaces and clusters.
Experience with Databricks job scheduling and workflow management.
Experience developing and maintaining production-grade ETL and ingestion pipelines in Databricks.
Familiarity with data quality, pipeline monitoring, and production support practices.

Β 

Employers have access to artificial intelligence language tools (β€œAI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91171215
  • Position Id: 9127820
  • Posted 7 hours ago

Company Info

About Trebecon LLC

Trebecon is a global leader in innovative IT solutions, product development, and professional staffing services. Our parent company is founded in 2015, we have grown into a trusted partner for Fortune 50 companies, U.S. state governments, and international organizations. We specialize in delivering scalable, sustainable, and future-ready technology solutions designed to drive operational efficiency, empower growth, and create lasting business value.

Our vision is to set a benchmark for excellence by aligning technology, talent, and trust. We believe in harnessing cutting-edge technologies while fostering meaningful client partnerships that go beyond project delivery. By combining innovation with integrity, Trebecon has become synonymous with delivering business outcomes that exceed expectations.

Our Mission

At Trebecon, our mission is rooted in integrity, collaboration, and performance. We are committed to:

- Delivering exceptional consultancy and IT services tailored to evolving client needs.

- Creating cost-effective, agile solutions that drive measurable impact.

- Nurturing long-term relationships built on trust, transparency, and mutual success.

- Fostering a thriving workplace culture that inspires innovation and teamwork.

Our Journey

Trebecon’s parent company started its journey in 2015 with a vision to transform industries through technology. By 2020, we had become a trusted technology partner for government agencies, insurance companies, and global enterprises. Strategic collaborations with Fortune 50 clients and international organizations enabled us to rapidly expand our footprint.

Despite market challenges in 2022, our resilience and innovation led to a strong comeback, resulting in tripled office space and workforce by 2024. Today, we are a forward-thinking company that combines global expertise with a passion for delivering world-class IT solutions.

What Sets Trebecon Apart?

- Innovative Solutions: We create tailored technologies that solve unique challenges and ensure scalability and future readiness.

- Expert Teams: Our professionals bring deep domain knowledge and technical excellence to every project.

- Client-Centric Approach: We prioritize understanding business needs, maintaining transparent communication, and ensuring long-term partnerships.

- Seamless Execution: From strategy to deployment, we minimize risks and maximize business value through agile processes.

Our Services & Expertise

We offer end-to-end services spanning AI & ML integration, product engineering, IT staffing, and cloud transformation. Whether building customized digital platforms or assembling dedicated remote teams, Trebecon ensures every solution is aligned with the client’s business objectives.

The Trebecon Edge lies in our ability to combine technology leadership with workforce empowerment. We build high-performing remote and hybrid teams to deliver next-gen solutions for enterprises worldwide.

About_Company_One
Contact the job poster
SJ

Shreya Jayasinghe

Recruiter @ Trebecon LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.