Data Engineer Principal

Plano, TX β€’ Posted 1 day ago β€’ Updated 10 hours ago
Full Time
On-site
USD $10,231.53 - 13,812.57 per month
Fitment

Dice Job Match Scoreβ„’

πŸ”’ Crunching numbers...

Job Details

Skills

  • Pivotal
  • Innovation
  • Business Software
  • Big Data
  • Supervision
  • Batch Processing
  • Network Layer
  • Modeling
  • Scalability
  • Streaming
  • Extract
  • Transform
  • Load
  • Apache Spark
  • Change Data Capture
  • Managed Services
  • Optimization
  • Business Intelligence
  • Cost Control
  • Storage
  • Use Cases
  • SQL
  • Caching
  • Meta-data Management
  • Instrumentation
  • Data Loss Prevention
  • Orchestration
  • Promotions
  • Analytics
  • Budget
  • Design Review
  • Mentorship
  • Coaching
  • Risk Assessment
  • RPO
  • Technical Direction
  • Apache Beam
  • Cloud Storage
  • Clustering
  • Regulatory Compliance
  • Virtual Private Cloud
  • DLP
  • Data Quality
  • Cloud Computing
  • Data Flow
  • Data Validation
  • Migration
  • Terraform
  • Continuous Integration
  • Continuous Delivery
  • Google Cloud
  • Google Cloud Platform
  • Computer Science
  • Mathematics
  • Training
  • Conflict Resolution
  • Problem Solving
  • Predictive Analytics
  • Data Engineering
  • Machine Learning (ML)
  • Information Systems
  • Leadership
  • Communication
  • Law
  • Insurance
  • Recruiting
  • FMLA
  • Immigration
  • Bilingual
  • English
  • Spanish

Summary

The Data Engineer Lead plays a pivotal role within Dataworks, focused on creating and driving engineering innovation within Dataworks, helping define and build the Dataworks organization and facilitate the delivery of key business initiatives. S/he acts as a "universal translator" between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer Lead will contribute to the creation of and adherence to technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code reviews and large-scale deployments. Under minimal supervision, supports the design, build, test and maintain data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under close supervision is to work on batch processing of collected data and match its format to the stored data, make sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and provide L3 support. Independently implements parsers, validators, transformers and correlators to reformat, update and enhance the data. Provides recommendations to highly complex problems. Provides guidance to those in less senior positions.

Essential Functions

  • Provide practical, hands-off guidance on Google Cloud Platform data platform and pipeline architecture: recommend patterns for ingestion, storage, modeling, and governance that match the organization's maturity and goals.
  • Review and critique proposed Google Cloud Platform designs and implementation plans for scalability, reliability, security, and cost; surface risks and pragmatic mitigation options.
  • Recommend Google Cloud Platform-specific ingestion and processing patterns: Pub/Sub -> Dataflow (Beam) streaming, Dataflow batch/ETL, Dataproc/Spark jobs, Transfer Service/Storage for bulk loads, and Datastream for CDC; suggest tradeoffs between managed services and containerized workloads.
  • Advise on BigQuery design and optimization: schema strategies, partitioning/clustering, materialized views, slots/reservations, BI Engine, cost-control patterns, and query performance best practices.
  • Recommend storage and stateful service patterns on Google Cloud Platform: Cloud Storage lifecycle/tiering, Bigtable/Firestore use-cases, Cloud SQL/AlloyDB considerations for analytics use, and caching strategies.
  • Propose metadata, catalog and lineage approaches using Data Catalog, Pub/Sub/Dataflow instrumentation, and integration with governance tools; define metadata and discovery expectations.
  • Advise on data quality and observability for Google Cloud Platform pipelines: validation checkpoints in Dataflow, Great Expectations or similar, Cloud Monitoring/Logging instrumentation, and data-SLO/SLI recommendations.
  • Define security and compliance guardrails on Google Cloud Platform at an architecture level: BigQuery IAM/data access models, Authorized Views, VPC Service Controls, Workload Identity, Cloud KMS/CMEK, Secret Manager, and Data Loss Prevention (DLP) patterns for PII.
  • Recommend CI/CD and deployment patterns for data workloads on Google Cloud Platform: Dataflow templates, Composer/Airflow orchestration, artifact promotion strategies, and IaC (Terraform) governance for data platform resources.
  • Provide cost/governance guidance specific to Google Cloud Platform analytics: labeling, budgets, BigQuery cost controls, committed use/flat-rate considerations, and high-level FinOps guardrails.
  • Produce concise guidance artifacts for engineering teams: Google Cloud Platform architecture checklists, design-review templates, migration playbooks for Google Cloud Platform services, runbook outlines, and cutover/validation checklists.
  • Mentor and upskill engineers on Google Cloud Platform data best practices via reviews, brown-bags, and targeted coaching; enable teams to adopt patterns without owning delivery.
  • Support migration and modernization efforts in an advisory capacity for Google Cloud Platform moves: contribute to risk assessments, cutover criteria, performance/RTO-RPO validation approaches, and rollback plans.

Preferred Knowledge, Skills, and Abilities
  • 5+ years in data engineering or related roles with experience advising or influencing technical direction; 2+ years working with Google Cloud Platform data services in a practical or architectural capacity.
  • Hands-on or review experience with core Google Cloud Platform data services: BigQuery, Dataflow (Apache Beam), Pub/Sub, Cloud Storage, Dataproc/Dataproc Serverless, Cloud Composer (Airflow), Datastream/Transfer Service, and Data Catalog.
  • Practical knowledge of BigQuery performance and cost patterns (partitioning, clustering, materialized views, reservations/slots) and common anti-patterns.
  • Familiarity with Google Cloud Platform security and compliance features relevant to data: IAM for datasets, Authorized Views, VPC Service Controls, Workload Identity, Cloud KMS/CMEK, Secret Manager, and DLP.
  • Experience advising on pipeline observability and data-quality approaches on Google Cloud Platform: Cloud Monitoring/Logging, traceability for Dataflow/Dataproc jobs, and data validation frameworks.
  • Experience participating in at least one Google Cloud Platform-focused data platform migration or modernization as an advisor, reviewer, or core contributor.
  • Strong verbal and written communication skills; ability to produce concise, actionable guidance and explain technical tradeoffs to engineering and non-engineering stakeholders.
  • Familiarity with Terraform and CI/CD patterns for Google Cloud Platform resources and data pipelines; conceptual understanding of GitOps for data workloads.
  • Certifications such as Google Professional Data Engineer or Google Cloud Architect are a plus but not required.

Minimum Education

Bachelor's Degree in Information Systems, Computer Science, or a quantitative discipline such as Mathematics or Engineering and/or equivalent formal training or work experience.

Minimum Experience

Five to Seven (5 - 7) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. Extensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines. Extensive knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies. Experience providing leadership in a general planning or consulting setting. Experience as a leader or a senior member of multi-function project teams. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements.

Domicile Information

This is a hybrid position located in Plano, TX. Candidates must live within 50 miles of the campus location. Employees will be required to work at the FedEx campus location several times per week. We will also consider candidates located in Pittsburgh, PA and Memphis, TN.

Preferred Qualifications:

Pay Transparency: This compensation range is provided as a reasonable estimate of the current starting salary range for this role across all potential locations. If this opportunity includes multiple job levels, the range is a reasonable estimate of the current starting salary for the lowest level to the current starting salary of the highest level. Actual starting pay would be determined by experience relative to the job, market level, pay at the location for this job and other job-related factors permitted by law. An employee may be eligible for additional pay, premiums, or bonus potential. The Company offers eligible employees health, vision and dental insurance, retirement, and tuition reimbursement.

Pay: Plano: $10,231.53/monthly-$13,812.57/monthly

Additional Details:

For details on our comprehensive benefits, click here.

Federal Express Corporation is an Equal Opportunity Employer including, Vets/Disability.

Reasonable accommodations are available for qualified individuals with disabilities throughout the application process. Applicants who require reasonable accommodations in the application or hiring process should contact

Applicants have rights under Federal Employment Laws:
  • Know Your Rights
  • Pay Transparency
  • Family and Medical Leave Act (FMLA)
  • Employee Polygraph Protection Act

E-Verify Program Participant: Federal Express Corporation participates in the Department of Homeland Security U.S. Citizenship and Immigration Services' E-Verify program (For U.S. applicants and employees only). Please click below to learn more about the E-Verify program:
  • E-Verify Notice (bilingual)
  • Right to Work Notice (English) / (Spanish)
Employers have access to artificial intelligence language tools (β€œAI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX17455c
  • Position Id: 85ef519363d7ed4c34d5e544e436ee4f
  • Posted 1 day ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.