Sr. Data Engineer

Charlotte, NC, US • Posted 6 hours ago • Updated 6 hours ago
Contract W2
On-site
$53.56 - $60.35/hr
Company Branding Image
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Financial Services
  • Finance
  • Training
  • Military
  • Oracle
  • Debugging
  • PSETS
  • Data Processing
  • Data Warehouse
  • Data Modeling
  • Incident Management
  • Data Migration
  • Cloud Computing
  • Git
  • Automated Testing
  • Jenkins
  • Continuous Integration and Development
  • Productivity
  • Apache Spark
  • Real-time
  • Python
  • PySpark
  • PL/SQL
  • SQL
  • Clustering
  • Query Optimization
  • Performance Tuning
  • Teradata
  • Ab Initio
  • Workflow
  • Orchestration
  • Scheduling
  • CA Workload Automation AE
  • Migration
  • Google Cloud
  • Google Cloud Platform
  • Management
  • Data Governance
  • Meta-data Management
  • Data Quality
  • Informatica Data Quality
  • Operational Excellence
  • Root Cause Analysis
  • Data Engineering
  • Auditing
  • Analytics
  • Documentation
  • Artificial Intelligence
  • GitHub
  • Code Review
  • Testing
  • Integration Testing
  • Specification Gathering
  • Extract
  • Transform
  • Load
  • Middleware
  • Scalability

Summary

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Software Engineer in Charlotte, NC (Hybrid).

Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

Contract Duration: 12 Months

Required Skills & Experience
  • 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 4+ years PL/SQL and SQL skills with proven experience in Oracle, Teradata, Python and/or BigQuery: complex query development, tuning, and debugging.
  • 4+ years Ab Initio skills with proven experience to build complex graphs, Psets, performance tuning.
  • 3+ years programming skills in Python; hands-on PySpark for distributed data processing
  • 3+ years of ETL/ETL design, data warehousing concepts, and data modeling best practices
Desired Skills & Experience
  • Production operations experience: monitoring, SLAs, incident response, root cause analysis, and performance optimization.
  • Experience working in hybrid environments (on-prem + cloud) and supporting data migration/modernization initiatives.
  • Experience with scheduling/orchestration in Autosys and Airflow-based orchestration (Cloud Composer direction).
  • Experience with Git-based workflows, code reviews, and automated testing practices for data pipelines.
  • Experience with Harness, Jenkins and uDeploy based CICD environments.
  • Practical experience using AI-assisted coding tools in daily development to improve productivity without compromising quality or security.
  • Ab Initio development/maintenance experience and/or hands-on migration of Ab Initio graphs to modern Spark/SQL patterns.
  • Experience with Dataplex and broader data governance concepts (metadata, classification, stewardship, lineage practices).
  • Experience with Informatica Data Quality implementation patterns (profiling, rules, scorecards/metrics, exception workflows).
  • Experience designing near real-time patterns (micro-batch/event-driven concepts) and handling late-arriving/out-of-order data.
  • Familiarity with Google Cloud Platform operational practices for data workloads (service accounts/IAM basics, job monitoring, quota/cost controls).

What You Will Be Doing
  • Build and maintain scalable batch and near real-time data pipelines using AB Initio, Python, ?PySpark, PL / SQL and SQL to ingest, transform, and publish curated datasets across on-prem and Google Cloud platforms.
  • Develop and optimize BigQuery transformations and data models, including partitioning, clustering, query optimization, and cost/performance tuning.
  • Support modernization/migration from Teradata and Ab Initio workflows to Google Cloud Platform/BigQuery, including logic re-platforming, reconciliation, parallel runs, and controlled cutovers.
  • Implement orchestration and scheduling for pipelines using legacy Autosys while driving migration toward Google Cloud Composer (Airflow), including dependency management, retries, SLAs, and backfills.
  • Apply data governance and discovery practices using Dataplex: metadata management, dataset organization, classification support, and ensuring data is consumption-ready.
  • Build and operationalize data quality controls using Informatica Data Quality: profiling, rule implementation, thresholds, exception handling, and embedding quality gates into pipelines.
  • Ensure operational excellence: monitoring, alerting, runbooks, incident triage/root cause analysis, and continuous improvements to reliability and performance.
  • Implement secure data engineering practices: least-privilege access, PII handling/masking where required, retention controls, and audit-friendly documentation.
  • Partner with product, analytics, and engineering stakeholders to translate requirements into clear data contracts, curated datasets, and maintainable documentation (data dictionaries, reconciliation notes, operational runbooks).
  • Must-have: Use AI-assisted coding tools (e.g., GitHub Copilot, Devin, or similar) to accelerate development while maintaining strong code review discipline, testing, and secure coding standards.
  • Closely partner with Product Owners, Architects and Engineers on definition, design, development, integration, testing and support of reliable and reusable Data pipelines.
  • Analyze highly complex business requirements; generate technical specifications to design ETL processes.
  • Act as an expert technical resource for analysis and provides critical direction to less experienced staff. Work with team members to provide insight into solving complex problems with middleware while leveraging enterprise and industry best practices (including scalability, availability, maintainability, and flexibility).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10105282
  • Position Id: 884151
  • Posted 6 hours ago

Company Info

About Motion Recruitment Partners, LLC

Motion Recruitment delivers IT Talent Solutions for Contract, Direct Hire, Managed Solutions and Statement of Work to all of North America from our 21 delivery centers. Our high-touch, specialized, team-based recruitment model’s success is proven through our exemplary track record in filling the most challenging IT positions for startup and enterprise clients alike. Our hyper-specialized tech focus results in a truly consultative approach for both our clients and candidates, within our recruiting areas of expertise: Software, Mobile, Data, Infrastructure, Cybersecurity, Product + UX and Functional.

Motion also delivers IT Consulting Solutions through the Motion Consulting Group (MCG) that create true digital transformation for IT projects in Agile Development & Coaching, DevOps & DevSecOps Solutions, and Managed Services for IT Operations.

We’re also the proud creators of Tech in Motion and the Timmy Awards, our North American community platform, events series and award program that connects over 250,000 tech enthusiasts to meet, learn, and innovate.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract

$75 - $80

Charlotte, North Carolina

Today

Easy Apply

Contract

$69.5 - $76.16

Remote

Today

Easy Apply

Contract

$40 - $60

Charlotte, North Carolina

Today

Easy Apply

Contract

$69.5 - $76.16

Search all similar jobs