Job Title: AWS Data Engineer
Location: Charlotte, NC
Duration: 6 Months + Extension
Bill Rate: $78/hour
Job Type: W-2 Contract
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
Job Summary:
We are looking for an experienced AWS Data Engineer to design, build, and optimize scalable batch and real-time data pipelines that process high-volume data, preferably within the Communications domain (e.g., Call Detail Records, network telemetry).
The ideal candidate has strong hands-on expertise across Spark, Java, Kafka, and the AWS/Cloudera data Lakehouse ecosystem, and is comfortable owning pipelines end-to-end from ingestion and transformation to performance tuning and compliance.
Responsibilities
- Design, build, and optimize scalable batch and real-time data pipelines using Apache Spark (Scala/Python), Core Java, and Apache Kafka to process high-volume data.
- Manage and maintain enterprise data lakehouse architectures spanning AWS and Cloudera environments, leveraging S3, Apache Iceberg, and Hive for scalable storage and querying.
- Implement Change Data Capture (CDC) and write complex SQL to integrate data from relational databases (Oracle, SQL Server) into dimensional data warehouses.
- Automate and orchestrate pipeline workflows using Unix shell scripting and Python.
- Lead and support migration of legacy Hadoop workloads to AWS cloud-native architectures.
- Monitor, troubleshoot, and tune JVM and Spark job performance to ensure reliability and efficiency at scale.
- Ensure all data pipelines and storage practices adhere to regulatory compliance and data governance standards.
- Collaborate with cross-functional teams (data architects, analysts, platform engineers) to translate business requirements into robust data solutions.
Equal Opportunity Employer: We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.