Sr Databricks Data Engineer :: W2 Position :: Remote

Remote • Posted 2 hours ago • Updated 2 hours ago
Contract W2
1 Year
No Travel Required
Able to Sponsor
Remote
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • Databricks
  • Data Engineer
  • Delta Lake
  • Photon
  • and Unity Catalog

Summary

Databricks Data Engineer

Location: Remote
Candidate Preference: Please share only strong, highly qualified profiles.

Job Summary

We are seeking an experienced Databricks Data Engineer to own the end-to-end migration strategy, target architecture, and technical execution for moving legacy ETL workloads to the Databricks Lakehouse.

The ideal candidate will have strong hands-on expertise in Databricks, PySpark, Delta Lake, Unity Catalog, Photon, and DataStage, with proven experience modernizing legacy data pipelines, optimizing Spark workloads, and implementing scalable data engineering solutions.

Key Responsibilities

Architectural Strategy & Governance

  • Design target Databricks Lakehouse architecture using Delta Lake, Photon, and Unity Catalog.
  • Establish coding standards, refactoring guidelines, optimization benchmarks, and PySpark best practices.
  • Analyze complex source-to-target dependencies and develop seamless dual-run/migration strategies.
  • Lead the technical deployment and integration of specialized migration accelerators.
  • Define scalable and maintainable architecture patterns for enterprise data migration.

Hands-on Engineering & Optimization

  • Review automated output from migration tools and manually refactor complex legacy ETL logic into high-performance PySpark notebooks.
  • Modernize legacy processing and eliminate inefficient patterns such as row-by-row processing and excessive lookups.
  • Optimize PySpark workloads using advanced Spark techniques, including:
    • Z-Ordering
    • Partitioning
    • Caching
    • Spark optimization techniques
  • Build robust Databricks Workflows and orchestrate complex DAGs based on source lineage and dependencies.
  • Develop, test, debug, and deploy production-grade data pipelines.
  • Troubleshoot performance, scalability, data quality, and migration issues.

Required Technical Skills

Core Platforms

  • Databricks
  • Delta Lake
  • Unity Catalog
  • Photon
  • DataStage

Languages & Frameworks

  • PySpark
  • Python
  • SQL
  • Shell scripting

Cloud & DevOps

  • AWS
  • CI/CD pipelines
  • Deployment automation and DevOps practices

Orchestration

  • Apache Airflow
  • Databricks Workflows

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91171215
  • Position Id: 9058940
  • Posted 2 hours ago

Company Info

About Trebecon LLC

Trebecon is a global leader in innovative IT solutions, product development, and professional staffing services. Our parent company is founded in 2015, we have grown into a trusted partner for Fortune 50 companies, U.S. state governments, and international organizations. We specialize in delivering scalable, sustainable, and future-ready technology solutions designed to drive operational efficiency, empower growth, and create lasting business value.

Our vision is to set a benchmark for excellence by aligning technology, talent, and trust. We believe in harnessing cutting-edge technologies while fostering meaningful client partnerships that go beyond project delivery. By combining innovation with integrity, Trebecon has become synonymous with delivering business outcomes that exceed expectations.

Our Mission

At Trebecon, our mission is rooted in integrity, collaboration, and performance. We are committed to:

- Delivering exceptional consultancy and IT services tailored to evolving client needs.

- Creating cost-effective, agile solutions that drive measurable impact.

- Nurturing long-term relationships built on trust, transparency, and mutual success.

- Fostering a thriving workplace culture that inspires innovation and teamwork.

Our Journey

Trebecon’s parent company started its journey in 2015 with a vision to transform industries through technology. By 2020, we had become a trusted technology partner for government agencies, insurance companies, and global enterprises. Strategic collaborations with Fortune 50 clients and international organizations enabled us to rapidly expand our footprint.

Despite market challenges in 2022, our resilience and innovation led to a strong comeback, resulting in tripled office space and workforce by 2024. Today, we are a forward-thinking company that combines global expertise with a passion for delivering world-class IT solutions.

What Sets Trebecon Apart?

- Innovative Solutions: We create tailored technologies that solve unique challenges and ensure scalability and future readiness.

- Expert Teams: Our professionals bring deep domain knowledge and technical excellence to every project.

- Client-Centric Approach: We prioritize understanding business needs, maintaining transparent communication, and ensuring long-term partnerships.

- Seamless Execution: From strategy to deployment, we minimize risks and maximize business value through agile processes.

Our Services & Expertise

We offer end-to-end services spanning AI & ML integration, product engineering, IT staffing, and cloud transformation. Whether building customized digital platforms or assembling dedicated remote teams, Trebecon ensures every solution is aligned with the client’s business objectives.

The Trebecon Edge lies in our ability to combine technology leadership with workforce empowerment. We build high-performing remote and hybrid teams to deliver next-gen solutions for enterprises worldwide.

About_Company_One
Contact the job poster
IN

Ishani Nair

Recruiter @ Trebecon LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs