Apply Now

Sr. Data Engineer, Data Platform

• Posted 2 hours ago • Updated 2 hours ago

Full Time

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

IT Strategy
Artificial Intelligence
Technical Drafting
Data Quality
Collaboration
Optimization
Recruiting
Team Building
Extract
Transform
Load
Data Engineering
Analytics
SQL
Snow Flake Schema
Amazon Redshift
Apache Spark
Orchestration
Python
Scala
Data Processing
Data Modeling
Data Warehouse
Cloud Computing
Amazon Web Services
Google Cloud
Google Cloud Platform
Microsoft Azure
Mentorship
Databricks
Real-time
Streaming
Apache Kafka
Amazon Kinesis
Data Governance
Meta-data Management
Machine Learning (ML)
Regulatory Compliance

IT Strategy
Artificial Intelligence
Technical Drafting
Data Quality
Collaboration
Optimization
Recruiting
Team Building
Extract
Transform
Load
Data Engineering
Analytics
SQL
Snow Flake Schema
Amazon Redshift
Apache Spark
Orchestration
Python
Scala
Data Processing
Data Modeling
Data Warehouse
Cloud Computing
Amazon Web Services
Google Cloud
Google Cloud Platform
Microsoft Azure
Mentorship
Databricks
Real-time
Streaming
Apache Kafka
Amazon Kinesis
Data Governance
Meta-data Management
Machine Learning (ML)
Regulatory Compliance

Summary

Senior Data Engineer responsible for architecting and leading the design of enterprise data platforms, data pipelines, and data infrastructure. This role combines technical expertise with mentorship, driving technical strategy and best practices while partnering with stakeholders to translate complex business requirements into scalable data solutions.

Responsibilities

Architect and design enterprise-scale data platforms and pipeline solutions using Spark, Azure Databricks, and related technologies.
Build and optimize data models and dimensional schemas for complex analytics and AI/MLuse-cases.
Lead technical design reviews and mentor junior data engineers on best practices and architectural patterns.
Establish data quality, governance, and metadata management frameworks across the platform.
Collaborate with stakeholders to define data requirements and translate them into technical solutions.
Drive optimization initiatives for data pipeline performance, cost, and reliability.
Participate in hiring and team building for the data engineering function.
Contribute to architectural decisions and long-term platform strategy.
Troubleshoot complex data pipeline failures and implement robust monitoring and alerting solutions.

Minimum Qualifications

5+ years experience in data engineering, analytics engineering, or related field.
Expert-level SQL and experience with modern data warehouses (Snowflake, BigQuery, Redshift, etc.).
Deep experience designing and maintaining large-scale data pipelines using Spark, Airflow, or similar orchestration tools.
Strong proficiency in Python or Scala for complex data processing.
Advanced understanding of data modeling, dimensional design, data warehousing concepts.
Experience with cloud platforms (AWS, Google Cloud Platform, or Azure) at scale.
Proven ability to mentor and guide junior engineers.

Preferred Qualifications

Experience architecting data platforms from the ground up.
Experience with Databricks, Delta Lake, and lakehouse architectures.
Expertise in real-time data streaming and event-driven architectures (Kafka, Kinesis).
Knowledge of data governance, data lineage, and metadata management systems.
Experience with ML infrastructure and feature stores.
Background in regulatory-heavy industries or complex compliance requirements.
Experience with infrastructure-as-code and DataOps practices.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: RTL805229
Position Id: 3c8445ca0e4bc5f88f9bf157fbcf490d
Posted 2 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sr. Data Engineer

Columbus, Ohio

•

Today

Job/Position Summary Responsibilities: Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Own end-to-end delivery of AI and ML solutions from problem definition to production deployment Build and maintain data pipelines using PySpark and Spark in Azure Databricks Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues. Implem

Full-time

Senior Software Engineer, Data Platform

Remote or San Francisco, California

•

Today

About Us: At Parafin, we're on a mission to grow small businesses. Small businesses are the backbone of our economy, but traditional banks often don't have their backs. We build tech that makes it simple for small businesses to access the financial tools they need through the platforms they already sell on. We partner with companies like DoorDash, Amazon, Worldpay, and Mindbody to offer fast and flexible funding, spend management, and savings tools to their small business users via a simple in

Full-time

USD 220,000.00 - 265,000.00 per year

Senior Architect, Data

Remote or Dallas, Texas

•

28d ago

Credera is a global consulting firm that combines transformational consulting capabilities, deep industry knowledge, AI and technology expertise to deliver valuable customer experiences and accelerated growth across various industries. We continuously evolve our services to meet the needs of future organizations and reflect modern best practices. Our unique global approach provides tailored solutions, transforming the most influential brands and organizations worldwide. Our employees, the lifebl

Full-time

Senior Architect, Data

Remote or Houston, Texas

•

28d ago

Full-time

Search all similar jobs