Overview
Skills
Job Details
Title: Data Engineer Location: Charlotte, NC (Onsite role)
Candidate Must be Need to be local in Charlotte NC
IMP Note: FACE TO FACE Interview required in Charlotte NC
The ideal candidate will have a strong background in data engineering, with hands-on experience working with legacy systems and building robust data lake pipelines. This hybrid role offers an exciting opportunity to work on modern data infrastructure while maintaining and integrating legacy data systems.
8+ years of experience in data engineering or related roles.
Strong proficiency in SQL, Python, Spark, or similar data processing tools.
Hands-on experience working with legacy systems and integrating them into modern data architectures.
Proven experience building and managing data lake pipelines and associated ETL/ELT processes.
Knowledge of cloud platforms (AWS, Azure, or Google Cloud Platform) is a plus.
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and storage in data lakes.
Integrate data from legacy systems with modern data platforms to ensure seamless data flow and accessibility.
Optimize and refactor legacy data processes to improve performance and scalability.
Collaborate with data analysts, data scientists, and stakeholders to understand data requirements and deliver effective solutions.
Implement data quality and validation processes to ensure accuracy and integrity of data.
Troubleshoot and resolve data pipeline issues, ensuring high availability and reliability.
Document data architecture, processes, and best practices.
Preferred Skills:
Experience with data migration and refactoring of legacy workflows.
Familiarity with Apache Kafka, Airflow, or other orchestration tools.
Knowledge of data governance and security best practices