Sabio infotech
Sabio infotech

Sr. Data Engineer – AWS & Streaming - Full Time

Hybrid in Charlotte, NC, US • Posted 3 hours ago • Updated 3 hours ago
Full Time
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Data Engineer
  • AWS
  • Amazon Web Services
  • Continuous Delivery
  • Continuous Integration
  • Data Engineering
  • Data Lake
  • Data Quality
  • Extract, Transform, Load
  • ELT
  • DevOps
  • Cloud Computing
  • PySpark
  • Python
  • Apache Flink
  • Data Integrity
  • Streaming

Summary

Job Title: Sr. Data Engineer – AWS & Streaming
Location: Fort Mill SC/Charlotte, NC/New York, NY (2-3 Days Hybrid)
Position: Full-Time
Duration: 6+ Months to Long Term
Experience level – 10+ Years
 
Role Summary:
We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms. 
 
Key Responsibilities:
  • Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python
  • Build event-driven workflows using AWS Lambda
  • Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink
  • Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation
  • Optimize data processing performance, scalability, reliability, and cost in cloud environments
  • Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline
 Required Skills:
  • Strong hands-on experience with Python and PySpark
  • Proven expertise in AWS Glue, Lambda, and other cloud-native data services
  • Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)
  • Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)
  • Strong understanding of distributed data processing and scalable architecture patterns
 Good-to-Have Skills
  • Experience with Apache Flink for real-time stream processing and stateful computations
  • Knowledge of KSQL or other streaming SQL engines
  • Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices
  • Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi
  • Experience working in enterprise or financial data environments
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91112738
  • Position Id: 9089311
  • Posted 3 hours ago
Contact the job poster
AR

abdul rahoof

Recruiter @ Sabio infotech
View Profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

AWS Data Engineer(12+ Years)

Hybrid in Charlotte, North Carolina

•

30+d ago

Easy Apply

Contract

Depends on Experience

Data Engineer - Cybersecurity Analytics - Onsite

Charlotte, North Carolina

•

Today

Full-time

USD 106,840.00 - 160,250.00 per year

AWS Data Architect

Hybrid in Fort Mill, South Carolina

•

30+d ago

Easy Apply

Full-time, Third Party

Depends on Experience

Data Engineer IV (Lead)

Charlotte, North Carolina

•

Today

Easy Apply

Contract

Search all similar jobs
More jobs at Sabio infotech in Charlotte, NC