Data Engineer 

Location: Charlotte, NC – Hybrid
Work Schedule: 3 Days Onsite per Week
Duration: 12–18 Months Contract

Priority: Charlotte/Local Candidates Preferred

Job Summary

We are looking for a Data Engineer II to support the development and maintenance of centralized data and analytics solutions. The consultant will build scalable data pipelines, integrate data from multiple technology platforms, transform and validate complex datasets, and develop reusable data structures that support reporting, analytics, and operational decision-making.

The ideal candidate will have strong hands-on experience with SQL, Python, ETL/data pipelines, PostgreSQL, MongoDB, data modeling, and data integration.

Key Responsibilities

• Design, develop, and maintain automated data ingestion and transformation pipelines.
• Integrate data from multiple databases, APIs, files, and operational systems.
• Develop data models, schemas, tables, views, and reusable data structures.
• Work with PostgreSQL, SQL Server, MongoDB, or similar database technologies.
• Transform raw and semi-structured data into analytics-ready datasets.
• Implement data quality, validation, accuracy, and reconciliation processes.
• Develop and maintain scalable ETL/data integration solutions.
• Troubleshoot data issues and identify root causes.
• Optimize SQL queries, indexes, database structures, and overall data processing performance.
• Support dashboards, reports, and visualization solutions by providing optimized datasets.
• Collaborate with architects, product owners, application developers, and analytics teams to define data requirements.
• Integrate data using REST APIs, file-based feeds, and other system interfaces.
• Participate in code reviews, testing, deployments, and production support.
• Document data flows, transformations, data models, and technical solutions.
• Participate in Agile ceremonies, sprint planning, estimation, and delivery activities.

Required Skills

• 3+ years of experience in Data Engineering, ETL, or Data Integration.
• Strong hands-on SQL skills.
• Experience with PostgreSQL, SQL Server, or similar relational databases.
• Hands-on experience with MongoDB or other NoSQL databases.
• Strong experience with Python, Java, Spark, or similar data-processing technologies.
• Experience developing and maintaining automated data pipelines.
• Understanding of data modeling, schema design, and data warehouse concepts.
• Experience implementing data quality and validation controls.
• Experience working with REST APIs and file-based data ingestion.
• Experience with large-scale operational or analytical datasets.
• Knowledge of database performance tuning, indexing, and query optimization.
• Strong troubleshooting and analytical skills.
• Good communication and technical documentation skills.

Preferred Skills

• Experience with Big Data technologies.
• Experience with Spark/PySpark, Hadoop, Kafka, or similar technologies.
• Experience with Grafana, Tableau, or Power BI.
• Experience with CI/CD practices.
• Experience with cloud-based data platforms.
• Experience with Docker/containers or OpenShift.
• Cloudera Administration or Development certification.
• Cloud, Docker/Container, or OpenShift certification.
• Previous experience in Banking/BFSI or financial services is a plus.