Location: Charlotte, NC
Salary: $68.00 USD Hourly - $73.00 USD Hourly
Description: Software Engineer, Data PipelinesWe are not accepting C2C or 1099 arrangements.Location: Charlotte, NC (Preferred) | Iselin, NJ
Employment Type: Contract (18 Months, with potential extension or conversion)
Work Model: Hybrid, 3 days per week in office (required)
About the RoleWe are seeking an experienced
Software Engineer, Data Pipelines to join a team supporting critical Fraud and Claims Analytics initiatives. In this role, you will design, develop, and optimize large-scale data pipelines that process and transform enterprise data assets while supporting the organization's migration from Teradata to Google Cloud Platform (Google Cloud Platform).
You will work closely with business stakeholders, data engineers, and platform teams to build scalable, reliable solutions that enable fraud detection, claims analysis, and data-driven decision making across the enterprise.
What You'll Do- Design, develop, and maintain scalable ETL and data pipeline solutions.
- Support the migration of large-scale data platforms from Teradata to Google Cloud Platform.
- Build and optimize data processing workflows using PySpark, Python, SQL, and Ab Initio.
- Develop and support data ingestion, transformation, and orchestration processes.
- Collaborate with stakeholders within Fraud and Claims Analytics to gather requirements and deliver data solutions.
- Ensure data quality, reliability, performance, and operational excellence across data platforms.
- Monitor, troubleshoot, and optimize production data pipelines.
- Contribute to cloud-based architecture and platform modernization initiatives.
Minimum Qualifications- Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.
- 5+ years of software engineering or data engineering experience.
- 4-6 years of hands-on experience with:
- SQL
- ETL development
- Python and PySpark
- Autosys
- Ab Initio
- Cloud technologies
- Experience building and supporting large-scale data pipelines and distributed data processing systems.
- Experience working in enterprise data environments with complex datasets.
Preferred Qualifications- Experience with Google Cloud Platform (Google Cloud Platform), including BigQuery.
- Experience with Kafka, Hadoop, and Teradata.
- Familiarity with Dremio and large-scale storage solutions.
- Google Cloud certifications.
- Experience supporting data modernization and cloud migration initiatives.
- Strong problem-solving, communication, and stakeholder management skills.
Technical EnvironmentThe team supports a large-scale data ecosystem consisting of:
- Google Cloud Platform (Google Cloud Platform)
- BigQuery
- PySpark
- Python
- Hadoop
- Ab Initio
- Dremio
- S3 Storage Grid
- Teradata (legacy platform)
The environment currently manages approximately
1,000 TB of data across 600-700 tables and is undergoing a strategic migration to Google Cloud Platform.
Additional Information- Backfill position.
- Charlotte, NC is the preferred location.
- Standard business hours with occasional after-hours support for critical production issues.
- Hybrid attendance is mandatory with three in-office days per week.
Ideal Candidate:A senior-level data engineer with deep expertise in building enterprise-scale data pipelines, strong experience with PySpark and ETL frameworks, and a proven track record of delivering cloud-based data solutions, preferably within Google Cloud Platform.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact: This job and many more are available through The Judge Group. Please apply with us today! 
Never miss an opportunity! Create an alert based on the job you applied for.