Data Engineer

Python, Microservices, SQL, spark, AWS, Hive, Data architecture
Contract W2, 12 Months
Depends on Experience

Job Description

ServerLogic has partnered with a local company to identify a contract Data Engineer for a 12 month project.

Job Duties:

Design and build reusable components, frameworks and libraries at scale to support analytics products. Design and implement product features in collaboration with business and Technology stakeholders

  • Identify and solve issues concerning data management to improve data quality

  • Clean, prepare and optimize data for ingestion and consumption

  • Collaborate on the implementation of new data management projects and re-structure of the

    current data architecture

  • Implement automated workflows and routines using workflow scheduling tools

  • Build continuous integration, test-driven development and production deployment frameworks

  • Collaboratively review design, code, test plans and dataset implementation performed by other

    data engineers in support of maintaining data engineering standards

  • Analyze and profile data for designing scalable solutions

  • Troubleshoot data issues and perform root cause analysis to proactively resolve product

Experience:

  • Strong understanding of data structures and algorithms

  • Strong understanding of solution and technical design

  • Has a strong problem solving and analytical mindset

  • Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders

  • Able to quickly pick up new programming languages, technologies, and frameworks

  • Advanced experience building cloud scalable, real time and high- performance data lake solutions

  • Experience with relational SQL

  • Experience with scripting languages such as Shell, Python

  • Experience with source control tools such as GitHub and related dev processes

  • Experience with workflow scheduling tools

  • In-depth understanding of micro service architecture

  • Strong understanding of developing complex data solutions

  • Experience working on end-to-end solution design

Dice Id : 10433716
Position Id : 5552
Originally Posted : 5 months ago
Have a Job? Post it