Cloud Data Engineer (Azure) for ConsumerConnection/OIP

  • Dearborn, MI
  • Posted 15 hours ago | Updated 15 hours ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 6 Month(s)

Skills

Postgres SQL
Python
PySpark
Azure Data lake and ADF

Job Details

Youngsoft, Inc. ( is a global software solutions IT company, delivering digital enterprise business betterment since 1996. Through collaborative engagement and discovery with our clients and vendors, we co-create industry specialized digital products, applications software, process, programs, and project outcomes. Headquartered in metro-Detroit, we leverage "pods" of Subject Matter Experts, Business Analysts, Solutions Architects, Software Engineers, and Project Managers, fused with HyperCare through our Global Support Centers. Through inclusivity, we share a singular vision to deliver world-class measurable upside results to our customers. It takes a village come join ours!

Job Summary:

Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

Postgres SQL knowledge is a plus.

Essential Job Functions:

  • Understand requirements and engage with team to design and deliver projects.
  • Design and implement data lake house projects within azure.
  • Design and develop application lifecycle utilizing Microsoft Azure technologies
  • Participate in design and planning and necessary documentation
  • Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
  • Hands on with Python development and Azure data pipelines
  • Engage with team to develop and deliver cross functional products
  • Postgres SQL knowledge is a plus

Key Skills

  1. Data Engineering and SQL
  2. Python
  3. PySpark
  4. Azure Data lake and ADF

Other Responsibilities:

  • Document and maintain project artifacts.
  • Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
  • Complete training as required for Privacy, Code of Conduct etc.
  • Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
  • Adhere to the company's compliance program.
  • Safeguard the company's intellectual property, information, and assets.

Minimum Qualifications and Job Requirements:

  • Bachelor's degree in CS.
  • 7 years of hands-on experience in designing and developing distributed data pipelines.
  • 5 years of hands-on experience in Azure data service technologies.
  • 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
  • Experience with data integration with APIs, Web services, Queues
  • Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
  • Working experience with writing SQL queries from scratch

Please respond with your updated resume, contact information

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.