ETL Data Engineer

  • Charlotte, NC
  • Posted 2 hours ago | Updated 2 hours ago

Overview

On Site
$50 - $50
Contract - W2
Contract - 1 month(s)
No Travel Required

Skills

Python
Sql Server
Ssis
ETL Development
ELT Patterns

Job Details

Job Description:

Responsibilities:
  • Build and maintain robust, scalable, and efficient ETL applications covering both batch and streaming flavors.
  • Collaborate with cross-functional teams, including product owners, architects, scrum masters and other stakeholders, to define project requirements, timelines, and deliverables.
  • Ensure the development adheres to best practices in coding standards, code reviews, and continuous integration/continuous deployment (CI/CD).
  • Implement and maintain security best practices across all cloud-based solutions to ensure data integrity and compliance with industry standards.
  • Stay updated with the latest trends and technologies in ETL and Python development, and drive the adoption of new tools and techniques that enhance productivity and efficiency.
Required Skills and Qualifications:
  • Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in software development with a focus on ETL/ELT patterns and Python based development, with at least 2 years in a senior/lead developer role.
  • Extensive hands-on experience with SQL Server, SSIS, SQL Agents etc.,
  • Advanced proficiency in Messaging platforms like Kafka
  • Strong understanding and experience in both batch and streaming ETLs pipelines
  • Strong knowledge of CI/CD pipelines and tools such as Jenkins, GitHub, UCD, Harness or similar.
  • Proficient in Git and branching strategies.
  • Excellent communication and collaboration skills, with the ability to articulate technical concepts to non-technical stakeholders.
  • Strong understanding of data systems architecture and data pipelines.
  • Knowledge and Experience in Unix shell scripting.
Preferred Skills:
  • Exposure to software development methodologies such as Agile or Scrum.
  • Experience and knowledge on orchestration tools such as Autosys, etc..
  • Understanding and experience on Liquibase-based deployment a plus
  • Understanding of Google Cloud Platform data solution components is a plus
  • Exposure/Experience on the Financial Services domain is a plus
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.