TATA Consultancy Services Limited
TATA Consultancy Services Limited

Databricks Tech Lead

Remote, OR, US • Posted 14 hours ago • Updated 14 hours ago
Full Time
No Travel Required
On-site
$130,000 - $140,000/yr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Database
  • Data Processing
  • Data Architecture
  • Data Integration
  • Databricks
  • Data Warehouse
  • Data Engineering
  • Business Data
  • Data Modeling
  • Data Quality
  • Meta-data Management

Summary

Must Have Technical/Functional Skills

· 10+ years of experience in Data Engineering, Data Architecture, ETL Modernization, or Enterprise Data

Platform Migration.

· 6+ years of hands-on Databricks experience in large-scale enterprise environments with Data

Modernization or migration to Databricks expertise.

· Strong expertise in Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Databricks

Workflows/Jobs.

· Proven experience assessing and migrating legacy data platforms, ETL solutions, and data warehouses

to Databricks.

· Experience with Alteryx workflow assessment, migration planning, and modernization.

· Strong understanding of data modeling, data pipelines, source-to-target mappings, data quality, and

performance optimization.

· Experience designing scalable Lakehouse architectures, including Medallion Architecture and Delta

Lake.

· Knowledge of cloud data architecture, security, governance, monitoring, CI/CD, and DevOps practices.

· Hands-on experience with Azure Databricks, ADLS, Azure Data Factory, Purview, Key Vault, and Azure

DevOps.

· Ability to lead technical discovery workshops, define migration strategies, prepare architecture

documentation, and provide technical leadership throughout delivery.

 

Roles & Responsibilities

· Lead the assessment of current-state data platforms, including source systems, data warehouses, databases, ETL/ELT pipelines, reporting environments, and Alteryx workflows. · Define and drive the migration and modernization strategy for legacy data platforms to Databricks Lakehouse Architecture. · Analyze existing data assets, transformation logic, dependencies, source-to-target mappings, data quality requirements, and performance considerations. · Identify workloads suitable for lift-and-shift migration versus those requiring redesign, refactoring, consolidation, or retirement. · Design target-state data architecture leveraging Databricks, Delta Lake, Medallion Architecture, and cloud-native data services. · Lead the migration of legacy ETL, data integration, and analytics workloads to Databricks using PySpark, SQL, Databricks Workflows, and related technologies. · Assess and modernize Alteryx workflows and legacy data processing solutions into scalable Databricks-based implementations. · Define best practices for data ingestion, transformation, orchestration, security, governance, monitoring, metadata management, and lineage tracking. · Conduct technical discovery workshops and architecture reviews with business, data engineering, analytics, and platform stakeholders. · Create architecture documents, migration roadmaps, dependency assessments, implementation plans, effort estimates, and risk mitigation strategies. · Provide hands-on technical leadership during proof-of-concept, pilot, and large-scale migration initiatives. · Guide and mentor development teams on Databricks architecture, coding standards, performance tuning, and engineering best practices. · Collaborate with cross-functional teams to ensure migration and modernization initiatives align with business objectives and delivery priorities. · Establish CI/CD, DevOps, testing, and deployment standards for Databricks-based data solutions. · Ensure compliance with enterprise security, governance, data privacy, and operational standards throughout the migration lifecycle. · Act as the primary technical lead for architecture decisions, solution reviews, and stakeholder communications related to Databricks modernization programs

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91172467
  • Position Id: 9125939
  • Posted 14 hours ago

Company Info

About TATA Consultancy Services Limited

Tata Consultancy Services (TCS) is the technology partner of choice for industry leading organizations worldwide. Since its inception in 1968, TCS has upheld the highest standards of innovation, engineering excellence, and customer service.

It has set an aspiration to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence. Rooted in the heritage of the Tata Group, TCS is focused on creating long term value for its clients, its investors, its employees, and the community at large.

With a highly skilled workforce spread across 55 countries and 202 service delivery centers across the world, the company has been recognized as a top employer in six continents. With the ability to rapidly apply and scale new technologies, the company has built long term partnerships with its clients – helping them emerge as perpetually adaptive enterprises.

Many of these relationships have endured into decades and navigated every technology cycle, from mainframes in the 1970s to artificial intelligence today.

TCS sponsors 14 of the world’s most prestigious marathons and endurance events, including the TCS New York City Marathon, TCS London Marathon and TCS Sydney Marathon with a focus on promoting health, sustainability, and community empowerment.

About_Company_OneAbout_Company_Two
Go to company profile
Contact the job poster
DK

Dinesh Kumar

Recruiter @ TATA Consultancy Services Limited

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at TATA Consultancy Services Limited in Remote, OR