Motion Recruitment Partners, LLC
Motion Recruitment Partners, LLC

Data Engineer

Charlotte, NC, US • Posted 9 hours ago • Updated 9 hours ago
Contract W2
On-site
$69.5 - $76.16/hr
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • Financial Services
  • Finance
  • Training
  • Military
  • Google Cloud
  • Google Cloud Platform
  • PySpark
  • Software Engineering
  • Evaluation
  • Regulatory Compliance
  • Extract
  • Transform
  • Load
  • ELT
  • Real-time
  • Reporting
  • Open Source
  • Cloud Computing
  • Analytical Skill
  • Database
  • Data Structure
  • Scalability
  • Collaboration
  • Data Governance
  • Meta-data Management
  • Data Quality
  • Workflow
  • Apache Airflow
  • Management
  • High Availability

Summary

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Data Pipeline Engineer in Charlotte, NC or Irving, TX (Hybrid).

Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

Contract Duration: 24 Months
Required Skills & Experience
  • 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education
  • Ability to design and develop ETL/ELT workflows and data pipelines for batch and real-time processing. (Google Cloud Platform or any other cloud platforms are fine I.E. PYSPARK)
  • Build and maintain data pipelines for reporting and downstream applications using open source frameworks and cloud technologies
  • Implement operational and analytical data stores leveraging Delta Lake and modern database concepts. (BIG QUERY OR SIMILAR APPS)
  • Optimize data structures for performance and scalability across large datasets.
  • Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement.
  • Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs.
What You Will Be Doing
  • Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.
  • Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors.
  • Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables.
  • Strategically collaborate and consult with client personnel.
  • Design and develop ETL/ELT workflows and data pipelines for batch and real-time processing.
  • Build and maintain data pipelines for reporting and downstream applications using open?source frameworks and cloud technologies.
  • Implement operational and analytical data stores leveraging Delta Lake and modern database concepts.
  • Optimize data structures for performance and scalability across large datasets.
  • Collaborate with architects and engineering teams to ensure alignment with target?state architecture.
  • Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement.
  • Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs.
  • Troubleshoot and resolve issues in data pipelines and ensure high availability and reliability.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10105282
  • Position Id: 872734
  • Posted 9 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Software Engineer

Charlotte, North Carolina

•

Today

Contract

USD 69.00 - 74.00 per hour

Software Engineer

Charlotte, North Carolina

•

Today

Contract

USD 69.00 - 74.00 per hour

Data Engineer

Charlotte, North Carolina

•

Today

Easy Apply

Contract

USD0 - USD0

ETL Data Engineer

Charlotte, North Carolina

•

Yesterday

Easy Apply

Contract, Third Party

$60 - $70

Search all similar jobs