Who we are looking for State Street Associates (SSA) is looking for a highly skilled and motivated Data Engineering with hands-on experience working with Oracle database and Databricks Spark on AWS.
This role will be responsible for managing and analyzing terabytes of data hosted in enterprise data warehouse and leveraging large-scale data platforms to advancing new research and product development in the form of thought leadership, market indicators, and analytical tools.
You'll work across both traditional and cloud-based platforms, using your expertise in big data processing, statistical analysis and machine learning to deliver scalable and meaningful outcomes.
Key responsibilities As a Data Engineering you will
- Promote data governance, security, and best practices in managing large volumes of sensitive business data, to compliance with company policies and regulatory requirements.
- Work with terabytes of structured and semi-structured data from our enterprise data warehouse, primarily stored in Oracle and integrated with Databricks Spark on AWS.
- Write efficient, production-quality SQL and PL/SQL queries for data extraction and transformation in Oracle.
- Leverage Databricks Spark and PySpark to process large datasets and build machine learning models in a distributed environment.
- Collaborate closed with business stakeholders to understand data requirements and translate them into technical solutions.
- Ensure deployment and operationalization of both traditional and cloud applications.
- Participate in scope definition, requirements analysis, functional and technical design, application build, product configuration, unit testing, and production deployment.
- Provide technical expertise and ownership in the diagnosis and resolution of issues, including the determination and provision of workaround solution or escalation to service owners.
- Conceptual POCs in new technologies or system integrations and scaling it to production grade.
- Document and interact with business and technology stake holders/team members as necessary.
- Experience in DevOPS is a plus with hands on experience in Jenkins, Git and any one artifactory tool.
Qualifications - Masters or B.S. degree in Computer Science, Data Science, Statistics Engineering or a related field.
- Expertise in Oracle database, with strong proficiency in SQL and PL/SQL, Oracle access control (roles, privileges, user management, and data security).
- Working knowledge of AWS core services, including S3, EC2/EMR, IAM, Athena, Glue or Redshift.
- Hands-on experience with Databricks Spark on large datasets, using PySpark, Scala, or SQL. Familiarity with Delta Lake, Unity Catalog or similar data Lakehouse technologies.
- Proficient in Linux environments, including experience with shell scripting, basic system operations, and navigating file systems.
- Deep understanding of data warehouse concepts and experience with data modeling, ETL/ELT pipelines, and performance tuning.
- Solid programming skills in Python for data transformation and machine learning (e.g., pandas, scikit-learn).
- Experience with BI tools such as Power BI and Tableau.
- Strong problem-solving and communication skills, with the ability to work across regions.
- 5+ years of experience in data engineering, with proven work managing large-scale datasets.
Salary Range: $120,000 - $202,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.
For a full overview, visit
About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
Job Application Disclosure: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Never miss an opportunity! Create an alert based on the job you applied for.
