Data Engineer
My client is seeking a Data Engineer to join a Regulatory Technology and Controls team. This role focuses on working with high?volume trading data to improve the accuracy, timeliness, and completeness of regulatory reporting and trade recordkeeping. The ideal candidate is passionate about data engineering and interested in financial services.
The Data Engineer will ingest and transform large volumes of Equity trading data in a cloud environment using Synapse, Spark, and Delta Lake. The role also includes migrating legacy SQL Server tables and T?SQL procedures into a modern cloud data platform.
The position involves enhancing regulatory reporting pipelines, troubleshooting data quality issues, and collaborating with regulatory, trading, and support teams. The engineer will validate that reporting accurately reflects trading activity and help design dashboards and reconciliations that improve oversight and decision?making.
This is a hybrid role requiring at least three days per week in the office.
Key Responsibilities:
- Maintain and enhance cloud-based Synapse/Spark data pipelines for regulatory reporting.
- Migrate legacy SQL Server/T?SQL processes to cloud-based Synapse, PySpark, and Delta Lake.
- Understand Equity trading workflows and how they map to data models.
- Analyze high?volume datasets using Python, Synapse, and Power BI.
- Implement data reconciliations and support critical production reporting.
- Partner with business teams to develop dashboards and reporting tools.
Profile Requirements
My client is looking for a motivated Data Engineer with experience working with high?volume data on cloud platforms like Azure, Spark, or Delta Lake. Strong coding skills in languages such as Python, C++, Java, C, or C# are required, along with familiarity with version control, automated testing, and CI/CD.
Experience with SQL Server and T?SQL is preferred. Knowledge of Equity trading or regulatory reporting is a plus. The role involves close collaboration with other engineers and analysts, so strong communication and teamwork skills are essential.
Basic Qualifications:
- 4+ years of experience with Synapse, Spark, or similar cloud data technologies.
- 4+ years of development experience in a modern programming language (Python, C++, Java, etc.).
- Experience with GitHub or similar tools for version control and CI/CD.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Bachelor's or Master's degree in a STEM field.
- 2+ years of experience with SQL Server, T?SQL, or SSIS.
- Experience building cloud or Kubernetes-based applications.
- Knowledge of Equity trading or regulatory reporting.
Never miss an opportunity! Create an alert based on the job you applied for.
.png?format=webp)
