Job DescriptionWe're seeking a future team member for the role of Data Pipeline Engineer to join our Data Innovation team. In this role, you will design and build the data pipelines that power our Investment Data Standard (IDS) and knowledge graph, enabling a unified, high-quality data ecosystem that supports analytics, AI, and client-facing solutions. You will partner closely with the Ontology/Knowledge Architecture lead and collaborate across platform, product, and data teams to deliver scalable, production-ready solutions aligned to our broader data transformation strategy. This role is located in Pittsburgh, PA or Lake Mary, FL.
In this role, you'll make an impact in the following ways:
- Design and build scalable pipelines to ingest and process data from internal platforms and external vendors across batch, streaming, and near real-time patterns.
- Transform diverse data formats (APIs, flat files, streaming, unstructured) into clean, standardized time-series and event-driven datasets aligned to IDS entity models.
- Develop reusable frameworks to normalize identifiers, symbology, units, hierarchies, and event data (e.g., corporate actions, transactions).
- Partner with Ontology/Knowledge architecture team to map source data to canonical entities, relationships, and attributes, enabling graph ingestion and entity resolution.
- Implement robust data quality controls (completeness, accuracy, consistency, schema drift, anomaly detection) with full lineage, provenance, and traceability (source IDS product).
- Enable multi-vendor data ingestion, comparison, and reconciliation, including source prioritization, hierarchy logic, and coverage/quality analytics.
- Build modular, reusable, cloud-native pipelines optimized for scale, performance, and cost (e.g., Snowflake), with monitoring and SLA-driven reliability.
- Collaborate cross-functionally to translate business and data requirements into production-ready pipelines and support downstream distribution via APIs, data products, and client platforms.
To be successful in this role, we're seeking the following:
- Bachelor's degree in a related discipline or equivalent work experience required. An advanced degree with a preference in statistics/statistical analysis is preferred.
- At least six years' total work experience, with at least 3 years' experience with a strong focus on data analysis and business intelligence is preferred.
- Extensive experience in data engineering, building and scaling production-grade data pipelines.
- Deep hands-on expertise in Python, Spark, and SQL, with strong experience in ETL/ELT frameworks and orchestration tools.
- Proven ability to design and operate high-volume, resilient pipelines across batch, streaming, and distributed environments.
- Strong understanding of structured and semi-structured data modeling, including time-series and event-driven architectures.
- Experience designing data transformation and normalization layers, including schema evolution and backward compatibility.
- Expertise with modern data platforms (e.g., Snowflake, AWS, Databricks), lakehouse architectures, and API-based data integration.
- Strong capabilities in performance tuning, cost optimization, and implementing data quality, monitoring, logging, and lineage frameworks.
- Domain experience with financial datasets (market data, pricing, reference data, portfolio holdings, transactions, corporate actions) and familiarity with key vendors (e.g., Bloomberg, ICE, MSCI).
- Exposure to knowledge graph/ontology-driven systems, entity resolution workflows, AI/LLM-based unstructured data integration (e.g., documents, PDFs), and data entitlements, licensing, and usage tracking is preferred.
About UsAt BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world's investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.
Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance - and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.
About the TeamAt BNY, our culture speaks for itself, check out the latest BNY news at BNY Newsroom & BNY LinkedIn
Here's a few of our recent awards:
- America's Most Innovative Companies, Fortune, 2025
- World's Most Admired Companies, Fortune 2025
- "Most Just Companies", Just Capital and CNBC, 2025
Our Benefits and Rewards:
BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life's journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.
BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.
BNY assesses market data to ensure a competitive compensation package for our employees. The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting.
Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Base salary is only part of the total rewards package, which may include eligibility for an annual discretionary incentive award. Subject to the terms and conditions of the applicable plans then in effect, eligible employees may enroll in a 401(k) plan as well as participate in Company-sponsored medical, dental, vision, and basic life insurance plans for the employee and the employee's eligible dependents. Eligible employees also may receive other benefits (including various paid time off benefits, such as vacation and sick time), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
If hired, the employee will be in an "at will" position and the Company reserves the right to modify base salary (as well as any other discretionary payments or compensation programs) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.
Never miss an opportunity! Create an alert based on the job you applied for.
