Overview
Skills
Job Details
Job Title: Lead Data Engineer
Location: Charlotte, NC (Local Candidates Only)
Experience: 12+ Years
Work Mode: Onsite
Job Type: Contract
Job Summary
We are seeking a highly experienced Lead Data Engineer to design, build, and lead the development of robust, scalable data platforms on the AWS ecosystem. The ideal candidate will have deep expertise in RDBMS systems, modern data formats, and cloud-based data engineering solutions, along with strong leadership and hands-on technical capabilities.
Key Responsibilities
Lead the design and implementation of enterprise-grade data platforms on AWS.
Architect and develop end-to-end data pipelines using AWS Glue, PySpark, Python, and S3.
Work extensively with RDBMS systems such as PostgreSQL and SQL Server for data ingestion, transformation, and analytics.
Handle and optimize multiple data formats including JSON, Parquet, and structured datasets.
Design and implement ETL/ELT workflows using DataStage and AWS-native services.
Ensure data quality, performance, scalability, and reliability across pipelines.
Collaborate with data architects, analytics teams, and business stakeholders.
Lead code reviews, enforce data engineering best practices, and mentor junior engineers.
Implement data governance, security, and compliance standards.
Optimize cloud cost, performance, and storage strategies on AWS.
Required Skills & Qualifications
12+ years of experience in Data Engineering.
Strong hands-on experience with AWS data services, including:
AWS Glue
Amazon S3
PySpark
Python
Experience with DataStage for ETL development.
Strong knowledge of RDBMS (PostgreSQL, SQL Server).
Experience working with modern data formats (JSON, Parquet).
Expertise in building large-scale, cloud-native data platforms.
Strong SQL development and performance tuning skills.
Experience leading teams and driving technical decisions.