Sr Staff - Data Platform Engineer

Remote • Posted 10 hours ago • Updated 10 hours ago
Full Time
Remote
USD $165,800.00 - 204,400.00 per year
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • Core Data
  • Optimization
  • Business Strategy
  • Roadmaps
  • Storage
  • Unity
  • Command-line Interface
  • Research and Development
  • Emerging Technologies
  • Regulatory Compliance
  • Access Control
  • Oracle Policy Automation
  • Apache Velocity
  • Systems Design
  • Mentorship
  • Recruiting
  • Professional Development
  • Data Engineering
  • Software Engineering
  • Systems Engineering
  • Java
  • Scala
  • Python
  • Rust
  • Orchestration
  • Docker
  • Hardening
  • Kubernetes
  • Amazon Web Services
  • Microsoft Azure
  • Amazon S3
  • Electronic Health Record (EHR)
  • Apache HTTP Server
  • Meta-data Management
  • Customization
  • Open Source
  • Apache Spark
  • Apache Flink
  • Terraform
  • Cloud Computing
  • Productivity
  • Workflow
  • Software Development
  • Software Development Methodology
  • Root Cause Analysis
  • Artificial Intelligence
  • Database
  • Leadership
  • Build Vs Buy
  • Computer Science
  • FOCUS
  • Sales
  • Life Insurance
  • Insurance

Summary

As a Sr. Staff Data Platform Engineer, you will be the primary architect and visionary for the core data infrastructure that powers the entire enterprise. This is a "platform-as-a-product" role; your mission is to build the internal foundation-creating the high-performance engines, abstraction layers, and self-service frameworks that enable hundreds of other engineers to move faster.

You will operate at the intersection of Systems Programming and Data Engineering, solving "hard-tech" problems like automated schema evolution, multi-engine compute optimization, and global data discovery. As a top-level technical individual contributor, you will bridge the gap between long-term business strategy and deep-kernel technical execution, ensuring WEX's data platform remains a competitive advantage.

Responsibilities
  • Architectural Sovereignty:Define the 3-5 year technical roadmap for the Data Lakehouse. You aren't just using tools; you are deciding how storage, compute, and metadata layers (e.g., Apache Polaris, Unity Catalog or Datahub Catalog) interact at an elemental level.
  • Platform-as-a-Product: Build internal SDKs, CLI tools, and automated orchestration frameworks. Your goal is to abstract away cloud complexity via Control Planes and Custom Operators, allowing Data Engineers to focus on business logic rather than infrastructure boilerplate.
  • Internal R&D:Prototype and benchmark emerging technologies (e.g., specialized Spark extensions, or Rust-based data accelerators) to keep the platform at the bleeding edge of performance and cost-efficiency.
  • Global Governance & Security: Architect "compliance-by-design" systems. Automate data lineage, PII masking, and fine-grained access control across petabyte-scale environments using Open Policy Agent (OPA) or similar frameworks without sacrificing developer velocity.
  • Engineering Excellence & Influence: Set the gold standard for code quality and system design across the company. You will lead Cross-Functional Architecture Reviews and serve as the final escalation point for the most complex system outages or performance bottlenecks.
  • Organizational Mentorship: Beyond individual mentoring, you will foster an "Engineering Community," influencing the hiring bar and professional development paths for the entire data engineering organization.
Qualifications & Experience
  • Experience: 15+ years in software engineering and distributed systems, with at least 4 years in a principal or staff-level capacity leading platform-scale initiatives.

Core Systems Engineering:
  • Expert-level proficiency in Java or Scala (JVM tuning is a must) and Python. Experience with Rust or Go for systems-level tooling or sidecars is a major advantage.
  • Deep experience building extensible frameworks-you have built libraries, APIs, or platforms used by other developers, not just end-user applications.

Cloud & Container Orchestration:
  • Advanced Docker Mastery: Deep understanding of container internals, multi-stage builds for polyglot environments, and security hardening (e.g., distroless images, rootless containers).
  • Kubernetes Control Planes: Advanced mastery of Kubernetes (EKS) for stateful workloads. Experience building custom CRDs (Custom Resource Definitions) and Operators to automate the lifecycle of data engines.
  • Multi-Cloud Substrate: Proven ability to architect across AWS and Azure, building cloud-agnostic abstractions that allow workloads to migrate or burst across providers (e.g., leveraging S3/ADLS Gen2 and EMR/HDInsight frameworks).

Data Lakehouse Mastery:
  • Deep internal knowledge of Apache Iceberg, Hudi, or Delta Lake (metadata management, manifest files, and compaction strategies).
  • Experience contributing to or deeply customizing open-source data projects (e.g., Spark, Trino, Flink).

Infrastructure-as-Code (IaC):
  • Expertise in Terraform or Pulumi at an enterprise scale. You have built reusable, governed module libraries that enforce organizational standards across hundreds of cloud accounts.

AI-Driven Development & Productivity:
  • Agentic Workflows: Experience integrating LLMs and AI agents into the software development lifecycle (SDLC) to automate code reviews, generate unit tests, and perform automated root-cause analysis of system failures.
  • LLM-Ops for Platform: Ability to architect the infrastructure required to support AI Agent development by enabling vector database integration.

Leadership & Vision:
  • Proven track record of "leading by influence"-driving adoption of new technologies across multiple autonomous teams.
  • Ability to communicate complex architectural trade-offs (e.g., "Latency vs. Consistency" or "Build vs. Buy") to C-suite executives and junior engineers alike.

Education:
  • Bachelor's or Master's degree in Computer Science (Distributed Systems focus) preferred, or equivalent deep industry experience.

The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of WEX's total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan. Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. WEX's comprehensive and market competitive benefits are designed to support your personal and professional well-being. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the "About Us" section.

Pay Range: $165,800.00 - $204,400.00
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10527711
  • Position Id: ac9e5e26b05119837e5fd944b2a161d6
  • Posted 10 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Portland, Maine

Today

Full-time

USD 185,000.00 - 217,400.00 per year

Remote

Today

Full-time

USD 121,500.00 - 145,500.00 per year

Remote

Today

Full-time

USD 110,400.00 - 220,800.00 per year

Remote or Denver, Colorado

Today

Full-time

USD 163,000.00 - 204,000.00 per year

Search all similar jobs