Principal Data Engineer

Charlotte, NC, US • Posted 2 hours ago • Updated 2 hours ago
Full Time
On-site
Depends on Experience
Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

  • Data engineering
  • kafka
  • Apache Kafka
  • Apache Spark
  • Data Lake
  • Apache Flink
  • SQL

Summary

Role Overview

Principal-level Java engineer to design and build enterprise-grade, real-time and batch data processing systems using Java, Spark, Kafka, and Microservices architecture. Strong focus on event-driven pipelines, API development (build + consume), and high-volume streaming platforms.

Key Responsibilities

* Architect, design, and implement enterprise-grade Java-based data platforms and distributed processing systems

* Build and maintain production-ready Spark applications (Java) for batch and real-time processing

* Design and evolve Kafka-based event streaming and ingestion pipelines

* Develop and consume REST APIs within microservices architecture

* Lead architecture ensuring scalability, reliability, and regulatory compliance

* Apply strong object-oriented design and engineering practices

* Mentor engineers on performance tuning and production readiness

* Design and implement MDM solutions (match, merge, survivorship logic)

* Ensure data quality, observability, and system stability

* Support production deployments and operational handoffs

Required Skills & Experience :

* 10 12+ years experience in Java/backend or data engineering

* Hands-on experience building real-time data pipelines (Kafka, Spark Streaming/Flink)

* Solid knowledge of relational databases (Redshift, PostgreSQL, Snowflake) and NoSQL databases (MongoDB or similar)

* Strong Kafka and event-driven architecture experience

* Strong Microservices experience (Spring Boot, REST APIs)

* Experience in API development and API consumption

* Hands-on Spark experience (batch and streaming)

* Strong SQL and data modeling skills

* AWS experience (S3, Glue, EMR, Redshift)

* Experience in regulated/data governance environments

* CI/CD, Git, Docker/Kubernetes familiarity

Preferred

* Scala or Python experience

* Talend/DataStage exposure

* Data lake experience (Iceberg/Parquet)

* Frontend/API integration exposure

* Experience supporting large-scale production systems

Candidates must have hands-on experience building real-time/event-driven data pipelines using Kafka and Spark/Flink, along with strong microservices and API development experience.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90868495
  • Position Id: 9009998
  • Posted 2 hours ago
Contact the job poster
RD

Raj Dhana

Recruiter @ P2PSoftTek Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

Today

Easy Apply

Contract

$68.00 - $68.25 per hour

Remote

15d ago

Easy Apply

Full-time, Third Party

Depends on Experience

Illinois

Today

Full-time

USD 150,000.00 - 224,000.00 per year

No location provided

Yesterday

Easy Apply

Contract

Search all similar jobs