Job Title: Data Engineer – ETL, Surveillance & Markets Analytics
Job ID: P-104029
Location: Pittsburgh, PA
Experience: 10–15+ Years
Duration: 6 Months
Ideal Candidate
The ideal candidate is a senior Data Engineer/Data Architect with strong Snowflake and Google Cloud Platform expertise plus hands-on Financial Markets/Trade Surveillance experience. Candidates with only general ETL/Data Engineering experience and no exposure to financial surveillance may not be suitable for this position.
Job Overview
We are looking for a senior Data Engineer / Data Architect with strong experience in ETL, Snowflake, Google Cloud Platform, data platform architecture, and financial market surveillance. The ideal candidate will have hands-on experience designing scalable data solutions for trading and surveillance environments and working with large financial datasets.
The candidate will work closely with Compliance, Surveillance Operations, Product, Architecture, and Engineering teams to onboard surveillance use cases, integrate data sources, improve data quality, and modernize surveillance platforms.
Key Responsibilities
- Lead the onboarding of surveillance use cases, venues, products, and data sources.
- Translate business and regulatory requirements into scalable data and ETL solutions.
- Design and implement end-to-end data architecture for order, execution, position, market, reference, employee, and communications data.
- Develop and optimize ETL/ELT pipelines for large-scale surveillance datasets.
- Design and optimize Snowflake-based data platforms and architectures.
- Utilize Google Cloud Platform cloud-native services to build scalable and resilient data solutions.
- Perform data profiling, gap analysis, reconciliation, root-cause analysis, and data validation.
- Establish controls for data completeness, accuracy, consistency, timeliness, lineage, and traceability.
- Develop and maintain source-to-target mappings and business rules.
- Support surveillance model tuning, calibration, effectiveness reviews, model validation, audits, and regulatory examinations.
- Work on surveillance use cases including market manipulation, insider trading, front-running, spoofing/layering, wash trading, employee trading, and information barriers.
- Develop KPIs, monitoring dashboards, and data-quality metrics.
- Partner with analysts to improve alert quality and reduce false positives.
- Support data governance, regulatory reporting, audit readiness, and compliance controls.
- Provide technical leadership across surveillance and data engineering initiatives.
- Partner with Product Owners and Program Managers on technical roadmaps and delivery.
Required Skills
- 10–15+ years of experience in Data Engineering, Data Architecture, or Data Platform Engineering.
- Strong hands-on experience with Snowflake and Snowflake architecture.
- Strong ETL/ELT and data pipeline development experience.
- Experience with Google Cloud Platform / Google Cloud and cloud-native data services.
- Experience working with large-scale financial, trading, or market datasets.
- Strong understanding of Trade/Market Surveillance.
- Experience with one or more surveillance platforms such as:
- NICE Actimize
- TradingHub
- Nasdaq SMARTS
- Behavox
- SteelEye
- ACA SIGMA
- eFlow
- Equivalent surveillance platforms
- Understanding of financial surveillance scenarios such as:
- Market manipulation
- Insider trading
- Front running
- Spoofing/layering
- Wash trading
- Employee trading
- Information barriers
- Strong experience with data quality, reconciliation, lineage, governance, and traceability.
- Experience with regulatory requirements including SEC, FINRA, CFTC, FCA, MAR, MiFID II, and/or Dodd-Frank.
- Strong analytical, troubleshooting, and communication skills.
Never miss an opportunity! Create an alert based on the job you applied for.
