Senior Data Engineer - Streaming

• Posted 7 hours ago • Updated 7 hours ago
Full Time
On-site
USD $152,000.00 - 178,300.00 per year
Company Branding Image
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Microsoft
  • CheckPoint
  • Management
  • Meta-data Management
  • Design Patterns
  • Dashboard
  • Routing
  • Apache Avro
  • JSON
  • Performance Tuning
  • Apache Spark
  • Apache Flink
  • Mechanics
  • Storage
  • Articulate
  • Streaming
  • Apache Kafka
  • Real-time
  • Database
  • Microsoft Azure
  • Analytics
  • Databricks
  • FOCUS
  • Agile
  • SAP BASIS
  • Regulatory Compliance
  • Privacy
  • Finance

Summary

We areseekinga highly specializedengineer inReal-time Streaming toevolve Coca-Cola's enterprisedataestatefrom batch-reliant processing to a continuous, event-driven ecosystem. In this role, your primary mission is to design, standardize, and codify streaming andKappa Architecturepatterns,minimizing redundant batch layers.

Rather than just building isolated data pipelines, you will architect the foundational frameworks,reference implementations, and low-code configurations that enable engineering teams across the organization to instantly deploy robust, real-time data streams. The target destination for our real-time data ecosystem is Microsoft Fabric(Spark Streaming and/orFabric Real-TimeIntelligence).

The ideal candidate is a champion of log-centric data design,possessesdeepexpertisein enterprise Apache Kafka environments.

Core Responsibilities

  • Build a reusable streaming architecture playbook for the enterprise, with a strong focus on Kappa-style patterns, event-driven processing, and near-real-time analytics on Fabric.

  • Architect, document, andtemplatizestandardized replay/backfill mechanisms (offset reset + checkpoint/state management + sink rebuild/dedupe strategy).

  • Contextualize Processing Latencyby creatingdistinct architectural blueprints and guardrails tailored to business SLAs:sub-second real-time and near-real-time

  • Abstract Streaming Complexitiesby packagingadvanced stream concepts(stateful processing, watermarking, late-arriving data remediation, and complex windowing)intoreusabletemplates.

  • Codify strict design patternsforeffectively-once /end-to-end idempotency with deterministic replay.

  • Build metadata-driven frameworks that gracefully handle upstream schema drift without interrupting or crashing 24/7 downstream streaming queries.

  • Act as the internal authority on streaming design patterns across Kafka/Event Hubs, designingscalableingestion into Fabric.

  • Build standardized dashboards to track critical stream health metrics, including end-to-end data lag, processing throughput, backpressure, and poison-pill routing via Dead Letter Queues (DLQ).

Required Qualifications & Experience

  • 8+ years of experience in data platform architecture, with a dedicated minimum of 3+yearsarchitecting and operating production-grade Streaming and Kappa Architectures.

  • 4+ years ofexperiencerunningSpark Streaming andApache Kafkapipelines. Must understand topic partitioning strategies, consumer group mechanics, schema registries (Avro/JSON), and performance tuning for high-throughput streams.

  • Deep familiarity with stream processing engines such as Spark Structured Streaming, Kafka Streams, or Apache Flink.

  • StrongScalaand/orPySparkexperience with stateful Structured Streaming.

  • Advanced knowledge of the internal mechanics of Delta Lake storage, specifically regarding append-only streaming sinks and checkpointing behaviors.

  • The "Framework" Mindset: A strong portfoliodemonstratingthe creation of developer-facing frameworks, custom connectors, or configuration-driven streaming engines that abstract infrastructure.

  • Abilityto articulate complex streaming topologies and real-time concepts to both application developers and executive stakeholders.

Preferred Qualifications

  • Confluent Certified Developer or Kafka Administrator certification.

  • Proven experience modernizing Lambda architectures toward Kappa-first designs.

  • Hands-on experienceutilizingFabric Real-Time Intelligence, including FabricEventstreamsand KQL Databases.(Equivalent deep experience with Azure Event Hubs, Stream Analytics, or Databricks DeltaLive).

The Coca-Cola Company will not offer sponsorship for employment status (including, but not limited to, H1-B visa status and other employment-based nonimmigrant visas) for this position. Accordingly, all applicants must be currently authorized to work in the United States on a full-time basis and must not require The Coca-Cola Company's sponsorship to continue to work legally in the United States.

Pay Range:
United States of America: 152,000 USD - 178,300 USD

Base pay offered may vary depending on geography, job-related knowledge, skills, and experience. A full range of medical, financial, and/or other benefits, dependent on the position, is offered.

Annual Incentive Reference Value Percentage:
15

Annual Incentive reference value is a market-based competitive value for your role. It falls in the middle of the range for your role, indicating performance at target.

Location(s):
United States of America

City/Cities:
Atlanta

Travel Required:
00% - 25%

Relocation Provided:
No

Job Posting End Date:
August 14, 2026

Our Purpose and Growth Culture:

We are taking deliberate action to nurture an inclusive culture that is grounded in our company purpose, to refresh the world and make a difference. We act with a growth mindset, take an expansive approach to what's possible and believe in continuous learning to improve our business and ourselves. We focus on four key behaviors - curious, empowered, inclusive and agile - and value how we work as much as what we achieve. We believe that our culture is one of the reasons our company continues to thrive after 130+ years. Visit to learn more about these behaviors and how you can bring them to life in your next role at Coca-Cola.

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class. When we collect your personal information as part of a job application or offer of employment, we do so in accordance with industry standards and best practices and in compliance with applicable privacy laws.

Pay Range:United States of America: 0 USD - 0 USD
Base pay offered may vary depending on geography, job-related knowledge, skills, and experience. A full range of medical, financial, and/or other benefits, dependent on the position, is offered.

Annual Incentive Reference Value Percentage:15
Annual Incentive reference value is a market-based competitive value for your role. It falls in the middle of the range for your role, indicating performance at target.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: coke
  • Position Id: R-144557
  • Posted 7 hours ago

Company Info

About The Coca-Cola Company

On May 8, 1886, Dr. John Pemberton brought his perfected syrup to Jacobs' Pharmacy in downtown Atlanta, where the first glass of Coca‑Cola was poured. In its first year, about nine Coca-Cola drinks were served per day.

Today, The Coca-Cola Company, with numerous brands sold across more than 200 countries and territories, serves 2.2 billion drinks per day. We own 32 billion-dollar brands across several beverage categories worldwide. Our global portfolio of beverage brands includes the following:

• Sparkling Soft Drinks: Coca-Cola, Diet Coke/Coca-Cola Light, Coca-Cola Zero Sugar, Fanta, Fresca, Schweppes (owned by The Coca-Cola Company in certain countries other than the United States), Sprite and Thums Up
• Water, Sports, Coffee and Tea: Aquarius, Ayataka, BODYARMOR, Ciel, Costa, Crystal, Dasani, Fuze Tea, Georgia, glacéau smartwater, glacéau vitaminwater, Gold Peak, I LOHAS, Powerade and Topo Chico
• Juice, Value-Added Dairy and Plant-Based Beverages: Core Power, Del Valle, fairlife, innocent, Maaza, Minute Maid, Minute Maid Pulpy, Santa Clara and Simply

Our strong and stable bottling and distribution system helps us capture growth by manufacturing, distributing and selling existing, enhanced and new innovative products to consumers throughout the world.

Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Georgia

Today

Full-time

USD 217,400.00 - 245,300.00 per year

Georgia

Today

Full-time

USD 202,000.00 - 229,000.00 per year

Georgia

Today

Full-time

USD 202,000.00 - 229,000.00 per year

Valley Stream, New York

Today

Full-time

Search all similar jobs