Curation Pipeline Engineer

Overview

On Site
USD 60.00 - 65.00 per hour
Full Time

Skills

Version control
Attention to detail
Extract
transform
load
Data processing
Data engineering
Big data
Workflow management
Apache Airflow
UI
Web development
Dashboard
Reporting
Software development
Java
Python
Scala
Auditing
Data
Git
Collaboration
Debugging
Organized
React.js
Communication
English
Apache Spark
Apache Hadoop
Cloud computing
Amazon Web Services
SQL
JavaScript
Quality assurance
Business analysis
Training

Job Details

.Responsibilities

  • Develop data pipeline to orchestrate the lifecycle of crowd grading tasks, build dashboard to monitoring and reporting the quality of tasks
  • Programming in one of the following languages: Java, Python, Scala
  • Audit a wide variety of data for correctness

Required Skills

  • Programming language - Python, Java, or Scala
  • Familiarity with Git or similar version control system
  • Good understanding of data processing concepts and data engineering process.
  • Able to frequently collaborate closely with a diverse tight-knit team
  • Experience investigating and/or debugging problems
  • Able to track, analyze, and report issues in a timely manner
  • Attention to detail and a commitment to quality, while delivering work on schedule
  • Highly organized and efficient
  • Flexibility to respond and react to changing priorities quickly and efficiently
  • Excellent oral and written communication in English

Highly Desired Skills

  • Big data processing, e.g. Spark/Hadoop
  • Cloud based services, e.g. AWS
  • Workflow management tools, e.g. Apache Airflow
  • SQL
  • UI design fundamentals
  • Web development technologies, such as React for JS
  • QA/QE

Education

  • BA or BS degree or equivalent work experience.

Pay Range: $60 - $65 The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.

Comments
Location: 100% remote. candidate location must be listed on resume Interview process: 3, 45 minute technical assessments Python is the main required skill and a Python assessment must be administered to each candidate prior to being submitted to the req, and the score must be listed on the resume at the top.

About Pinnacle Group