AWS Data Engineer

Job Title: AWS Data Engineer

Location: Charlotte, NC

Job Type: Full-Time

Experience: 8-10 Years

Job Summary

We are seeking an experienced AWS Data Engineer to design, build, and optimize scalable, event-driven data platforms on AWS. The ideal candidate will have strong expertise in AWS data services, real-time streaming architectures, ETL development, and Infrastructure as Code (Terraform). This role will focus on building high-performance data pipelines supporting fraud detection, analytics, and customer engagement platforms.

Required Skills

AWS Data Engineering

• Strong hands-on experience with:
  • AWS Lambda
  • Amazon S3
  • Amazon EventBridge
  • Amazon Kinesis (Data Streams & Firehose)
  • AWS Glue (ETL & Crawlers)
  • AWS Step Functions
  • Amazon Athena
  • Amazon Connect
  • Amazon Macie
• Experience designing and implementing AWS Data Lake architectures

Programming & Data Processing

• Strong proficiency in:
  • Python
  • PySpark
• Experience developing:
  • ETL/ELT Pipelines
  • Data Transformation Workflows
  • Real-Time Data Processing
• Hands-on experience with:
  • Parquet File Format
  • Glue Crawlers
  • AWS Glue Data Catalog

Streaming & Event-Driven Architecture

• Experience with:
  • Event-Driven Architecture
  • Publish/Subscribe (Pub/Sub) Models
  • Apache Kafka
  • Amazon EventBridge
  • Kinesis Data Streams
  • Kinesis Firehose

DevOps & Infrastructure

• Hands-on experience with:
  • Terraform (Infrastructure as Code)
  • CI/CD Pipelines
  • Cloud Automation
• Experience deploying and managing AWS infrastructure

Data Analytics & Security

• Experience using:
  • Amazon Athena
  • AWS Glue Catalog
  • Amazon Macie
• Strong understanding of:
  • Data Governance
  • Data Security
  • Data Integrity
  • Performance Optimization

Key Responsibilities

• Design and implement scalable AWS-based data engineering solutions
• Develop real-time event-driven architectures using EventBridge, Kafka, and Kinesis
• Build and optimize ETL pipelines using AWS Glue, Python, and PySpark
• Configure and manage AWS Glue Crawlers for automated schema discovery and metadata management
• Design and maintain data lakes using Amazon S3, Parquet, Glue Catalog, and Athena
• Develop integrations between Customer Profiles, messaging platforms, and downstream systems
• Build automated workflows using AWS Step Functions
• Provision and manage AWS infrastructure using Terraform
• Implement CI/CD pipelines for automated deployment and infrastructure management
• Perform end-to-end testing, monitoring, troubleshooting, and performance tuning
• Optimize cloud architecture for scalability, reliability, cost efficiency, and security
• Maintain technical documentation, architecture diagrams, and operational runbooks

Preferred Qualifications

• Experience in fraud detection or financial services platforms
• AWS Certifications (Solutions Architect, Data Engineer, or Developer Associate)
• Experience with:
  • Lakehouse Architectures
  • Streaming Analytics
  • Cloud-Native Data Platforms
• Knowledge of DevOps best practices and Infrastructure Automation