Apply Now

Senior Data Engineer

Atlanta, GA, US • Posted 5 days ago • Updated 11 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

Enterprise Architecture
Pivotal
Open Source
Engineering Support
Data Integrity
Version Control
Continuous Integration
Continuous Delivery
Collaboration
Data Integration
Kubernetes
Mentorship
Computer Science
Computer Engineering
Data Science
Mathematics
Data Engineering
Workflow
Performance Tuning
Operations Management
Testing
SQL
Python
Data Quality
Automated Testing
Orchestration
Managed Services
Machine Learning (ML)
Artificial Intelligence
Extract
Transform
Load
Real-time
Data Processing
Streaming
Data Modeling
Warehouse
IT Management
Microsoft Exchange

Enterprise Architecture
Pivotal
Open Source
Engineering Support
Data Integrity
Version Control
Continuous Integration
Continuous Delivery
Collaboration
Data Integration
Kubernetes
Mentorship
Computer Science
Computer Engineering
Data Science
Mathematics
Data Engineering
Workflow
Performance Tuning
Operations Management
Testing
SQL
Python
Data Quality
Automated Testing
Orchestration
Managed Services
Machine Learning (ML)
Artificial Intelligence
Extract
Transform
Load
Real-time
Data Processing
Streaming
Data Modeling
Warehouse
IT Management
Microsoft Exchange

Summary

Overview

Job Purpose

We're seeking a talented Senior Data Engineer to join our Enterprise Architecture team in a cross-cutting role that will help define and implement our next-generation data platform. In this pivotal position, you'll lead the design and implementation of scalable, self-service data pipelines with a strong emphasis on data quality and governance. This is an opportunity to shape our data engineering practice from the ground up, working directly with key stakeholders to build mission-critical ML and AI data workflows.

Responsibilities

Design, build, and maintain our on-premises data orchestration platform using the best-in-breed open source tools
Create self-service capabilities that empower teams across the organization to build and deploy data pipelines without extensive engineering support
Implement robust data quality testing frameworks that ensure data integrity throughout the entire data lifecycle
Establish data engineering best practices, including version control, CI/CD for data pipelines, and automated testing
Collaborate with ML/AI teams to build scalable feature engineering pipelines that support both batch and real-time data processing
Develop reusable patterns for common data integration scenarios that can be leveraged across the organization
Work closely with infrastructure teams to optimize our Kubernetes-based data platform for performance and reliability
Mentor junior engineers and advocate for engineering excellence in data practices

Knowledge and Experience

At least a Bachelor's degree in Computer Science, Computer Engineering, Data Science, Mathematics, Engineering, or related disciplines.
5+ years of professional experience in data engineering, with at least 2 years working on enterprise-scale data platforms
Deep expertise with orchestrating workflows, performance optimization, and operational management
Strong understanding of data transformation techniques, including experience with testing frameworks and deployment strategies
Experience with stream processing frameworks and technologies
Proficiency with SQL and Python for data transformation and pipeline development
Familiarity with containerized application deployment
Experience implementing data quality frameworks and automated testing for data pipelines
Ability to work cross-functionally with data scientists, ML engineers, and business stakeholders

Preferred Qualifications

Experience with self-hosted data orchestration platforms (rather than managed services)
Background in implementing data contracts or schema governance
Knowledge of ML/AI data pipeline requirements and feature engineering
Experience with real-time data processing and streaming architectures
Familiarity with data modeling and warehouse design principles
Prior experience in a technical leadership role

#LI-HR1 #LI-ONSITE

-

Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10123334
Position Id: 940775e64bcb3a8b821dde41e42ef8be
Posted 5 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Staff Data Platform Engineer

Remote or Atlanta, Georgia

•

Today

At PrizePicks, we are the fastest-growing sports company in North America, as recognized by Inc. 5000. As the leading platform for Daily Fantasy Sports, we cover a diverse range of sports leagues, including the NFL, NBA, and Esports titles like League of Legends and Counter-Strike. Our team of over 550 employees thrives in an inclusive culture that values individuals from diverse backgrounds, regardless of their level of sports fandom. Ready to reimagine the DFS industry together? Staff Data Pla

Full-time

USD 200,000.00 - 220,000.00 per year

Senior Data Engineer for Indeed ID82269

Atlanta, Georgia

•

Today

Job Description AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to d

Full-time

Data Engineer

Atlanta, Georgia

•

16d ago

Please do not respond to direct messages with your personal information. All job applications and your sensitive, personal information should only be submitted via our official job platform. Job Title: Data Engineer (hybrid) Location: US-GA-Atlanta (Sandy Springs) FLSA: Exempt #LI-Hybrid Job Overview: The Data Engineer leads complex data engineering projects and drives innovation in data architecture and automation. Job Responsibilities: Oversee the end-to-end delivery of large-scale data

Full-time

Data Engineer

Atlanta, Georgia

•

Today

Job Family: Data Science & Analysis Travel Required: Up to 10% Clearance Required: Ability to Obtain Public Trust What You Will Do: Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and will collaborate with cross-functional teams to deliver high-quality,

Full-time

USD 89,000.00 - 148,000.00 per year

Search all similar jobs

More jobs at Intercontinental Exchange, Inc in Atlanta, GA