Senior Data Engineer & Tech Lead
W2 Only
REMOTE
Role Description and Primary Responsibilities
The Senior Data Engineer & Tech Lead will drive the Business Insurance data modernization program for Travelers for Umbrella and/or Workers Compensation lines of business. This role leads the design and delivery of scalable data solutions on Databricks and AWS, guides a team of offshore data analysts, data engineers and quality engineers , and ensures data quality and reliability across the platform – while ensuring distribution on deliverables, work items and planning capacity.
Primary responsibilities:
• Lead large-scale data modernization efforts, from architecture through delivery
• Design, build, and optimize ETL processes and data orchestration workflows in Databricks
• Implement data governance and access control using Unity Catalog
• Build and maintain data pipelines on AWS using Glue jobs, Step Functions, and Lambda, with S3 for storage and Athena for querying
• Implement and maintain a data quality framework
• Oversee testing cycles to ensure accurate, reliable releases
• Provide technical leadership, mentoring, and code review for the engineering team
• Manage project timelines, priorities, and stakeholder communication, using JIRA to plan sprints, track work, and report progress
Required Qualifications, Skills, and Experience
• Proven experience leading large-scale data modernization initiatives
• Strong proficiency in Databricks, including:
o ETL development
o Data orchestration
o Unity Catalog
• Understanding of AWS, including:
o Data pipelining using Glue jobs, Step Functions, and Lambda
o S3 for data storage and Athena for querying
• Strong project management skills and stakeholder management skills
• Experience implementing data quality frameworks and overseeing testing cycles
• Ability to provide technical leadership, including mentoring engineers and conducting code reviews
• Ability to communicate effectively with stakeholders
Preferred Qualifications and Nice-to-Have Experience
• Business insurance domain experience (commercial or general insurance)
• Experience acting as a Project Manager or Scrum Master, including running Scrum ceremonies (sprint planning, daily stand-ups, reviews, retrospectives) and managing backlogs, sprints, and reporting in JIRA
