We are seeking a highly experienced
Senior Lead with deep expertise in
Databricks and modern data engineering technologies , combined with strong
Java and Spring Boot backend development experience . This role is focused on
hands-on development, technical leadership, and delivery execution for large-scale, production-grade platforms.
The Senior Lead will actively contribute to development while guiding teams, ensuring high code quality, performance, and reliability. The role works closely with QA, DevOps, and product teams and provides leadership across the full development lifecycle-from design through production support.
Key Responsibilities - Act as a senior hands-on developer and technical lead for Databricks-based solutions using Python, PySpark, Scala, and Spark SQL.
- Lead development of high-volume batch and real-time data pipelines on Databricks, ensuring performance, scalability, and reliability.
- Design, develop, and maintain backend services and batch processes using Java/J2EE and Spring Boot.
- Experienced in Axiom with working knowledge in Regulatory reporting FR2052a.
- Write efficient and optimized SQL for data transformation, validation, and analytics use cases.
- Perform data processing, tuning, and optimization across Databricks and relational databases (including Oracle).
- Own day-to-day development execution, including task planning, code guidance, and delivery tracking.
- Conduct code reviews, enforce development standards, and ensure adherence to best practices.
- Work closely with QA teams to ensure test coverage, defect resolution, and high-quality releases.
- Partner with DevOps teams to support CI/CD pipelines, deployments, and environment stability.
- Troubleshoot and resolve production issues, performing root-cause analysis and implementing permanent fixes.
- Mentor and guide junior and senior developers, fostering strong engineering discipline and collaboration across global teams.
- Contribute to technical documentation related to development standards, runbooks, and operational support.
- Support modernization initiatives, including migration of legacy workloads to Databricks-based platforms.
Required Experience & Skills - 15+ years of overall IT experience, with strong background as a Technical Lead.
- Hands-on experience with Axiom, Databricks, including Python, PySpark, Scala, Spark SQL.
- Experience working in Financial domain and Regulatory reporting
- Experience in Java, J2EE, Spring Boot, and backend application development.
- SQL skills with experience in data transformation and performance tuning.
- Exposure to Unix/Linux environments.
- Experience with CI/CD pipelines, build automation, and deployment processes.
- Strong understanding of the software development lifecycle, including development, testing, release, and production support.
- Experience working in Agile/Scrum delivery environments.
- Proven ability to lead and mentor globally distributed development teams.
- Excellent debugging, problem-solving, and communication skills.
Preferred Qualifications - Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Experience in financial services or regulated enterprise environments.
- Exposure to AWS supporting Databricks and backend workloads.
- Experience supporting mission-critical, high-availability production systems.
Salary Range: $120,000 - $202,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.
For a full overview, visit
About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
Job Application Disclosure: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Never miss an opportunity! Create an alert based on the job you applied for.
