Principal Data Engineer

Requisition ID: 267686

Salary Range: -

Please note that the Salary Range shown is a guideline only. Salary offered may vary based on factors, including, but not limited to, the successful candidate's relevant knowledge, skills, and experience.

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

Purpose

Principal Data Engineer will lead the design and evolution of enterprise-scale, multi-cloud data platforms and ingestion capabilities. This role is responsible for defining technical architecture, establishing engineering standards, and solving complex data integration challenges across cloud ecosystems including Azure, Google Cloud Platform (Google Cloud Platform), AWS, and modern Lakehouse platforms.

As a senior technical leader, you will drive the design of resilient, high-volume data ingestion frameworks, establish reusable patterns for onboarding diverse data sources, and provide hands-on leadership to engineering teams. You will partner closely with Enterprise Architects, Solution Architects, Product Owners, Data Scientists, Business Systems Analysts, Security, and Platform Engineering teams to deliver scalable, secure, and cost-efficient data solutions that enable enterprise AI, analytics, and regulatory initiatives.

What You'll Do

• Architect and lead the implementation of enterprise-scale data ingestion frameworks and patterns capable of processing structured, semi-structured, streaming, and unstructured data across hybrid and multi-cloud environments.
• Define and implement reusable ingestion frameworks, reference architectures, and engineering standards that accelerate source onboarding and reduce delivery complexity.
• Lead the technical design and optimization of high-throughput batch, streaming, CDC (Change Data Capture), API, event-driven, and file-based integration patterns.
• Design and implement data pipelines for mission-critical workloads, ensuring scalability, resiliency, observability, security, and operational excellence.
• Solve complex data integration challenges involving SaaS platforms, databases, mainframes, data warehouses, real-time messaging systems, and third-party applications.
• Establish robust data quality, lineage, metadata, reconciliation, and governance controls throughout the ingestion lifecycle.
• Drive adoption of modern engineering practices including Infrastructure-as-Code, CI/CD, automated testing, GitOps, and DevSecOps.
• Define and implement platform observability strategies including monitoring, logging, alerting, performance tuning, and operational support models.
• Provide technical leadership, architectural guidance, and mentorship to engineering teams while driving engineering excellence across multiple initiatives.
• Evaluate emerging technologies and recommend strategies to improve scalability, reliability, performance, security, and cost optimization of enterprise data platforms.

What You'll Bring

Technical Leadership & Architecture

• 10+ years of experience designing and delivering large-scale enterprise data platforms.
• Proven experience architecting cloud-native and hybrid data solutions across Azure, AWS, and/or Google Cloud Platform.
• Deep expertise designing enterprise ingestion architectures supporting high-volume, high-velocity, and mission-critical data workloads.
• Experience establishing technical roadmaps, reference architectures, engineering standards, and platform operating models.
• Strong ability to lead complex technical discussions and influence senior stakeholders across business and technology organizations.

Data Engineering & Integration

• Expert-level experience building resilient, scalable ETL/ELT, CDC, event-driven, streaming, and batch ingestion pipelines.
• Extensive experience integrating data from enterprise applications, SaaS platforms, APIs, relational databases, NoSQL databases, messaging platforms, data warehouses, and external partner systems.
• Strong understanding of data modeling, schema evolution, metadata management, data lineage, and data governance principles.
• Experience implementing end-to-end data quality frameworks, reconciliation processes, and operational controls.
• Deep expertise working with structured, semi-structured, and unstructured datasets at enterprise scale.

Platforms & Technologies

• Expertise with modern Lakehouse architectures, including Databricks and Delta Lake.
• Strong experience with cloud-native data services across Azure, AWS, and Google Cloud Platform.
• Advanced programming skills in Python, SQL, Scala, and Java.
• Experience with distributed processing frameworks and large-scale data processing technologies.
• Experience with event-streaming and messaging technologies such as Kafka, Event Hubs, Pub/Sub, or equivalent platforms.
• Strong understanding of containerization, orchestration, microservices, and cloud-native architecture patterns.

DevOps & Engineering Excellence

• Extensive experience implementing CI/CD pipelines using GitHub, Bitbucket, Azure DevOps, GitLab, Terraform, and Infrastructure-as-Code practices.
• Strong experience embedding security controls, compliance requirements, and automated testing into engineering pipelines.
• Demonstrated expertise in troubleshooting, root-cause analysis, performance optimization, and production support.

Communication & Collaboration

• Ability to translate complex technical architectures into clear business outcomes for executive and non-technical audiences.
• Proven track record of leading cross-functional teams and delivering complex data programs in large enterprise environments.
• Strong mentorship and coaching capabilities with a passion for developing engineering talent.

Preferred Qualifications

• 5+ years of experience with Databricks and Lakehouse architecture.
• Experience supporting enterprise AI, machine learning, analytics, or real-time decisioning platforms.
• Experience designing multi-region, highly available, and disaster-resilient data platforms.
• Knowledge of enterprise governance, regulatory, privacy, and security requirements within highly regulated industries.

Interested?

If your experience is closely related but doesn't align perfectly with every qualification, we do encourage you to apply - you might be the right candidate for this or other roles at Scotiabank!

At Scotiabank, every employee is empowered to reach their fullest potential, respected for who they are and, embraced for their differences. That's why we work to grow and diversify talent and engage employees in a performance-oriented culture.

What's in it for you?

Scotiabank wants you to be able to bring your best self to work - and life, every day. With a focus on holistic well-being, our many flexible benefit programs are designed to help support your unique family, financial, physical, mental, and social health needs.

#Dallas

Location(s): United States : Texas : Dallas

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Scotiabank is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by federal, state, or local law.