Data Pipelining Software Engineer

Python, Tableau, API, MongoDB, Database
Contract W2, 5 Months
$70 - $80

Job Description

General tasks 
  • Maintain centralized data repository, including updating python code for comparing and analysing datasets as necessary 
  • Run pipeline to process above data, generate synthesis and produce output files (python command) 
  • Work with team members to automate data pipeline 
  • Interface with crowd vendors to debug any data issues occurring in the pipeline 
  • Execution data pipelines for metrics: given a metric requirement and access to where the data lives, create a pipeline so that it’s made available for consumption (by dashboards, Tableau, etc) 
  • Maintain metrics database (MongoDB) 
  • Work with internal and external APIs to obtain and process data 
  • Fluent in Python, especially for data processing. 
  • Experience working with Python’s pandas, numpy and json libraries. 
  • Experience integrating with external APsI and HTTP requests (in Python): GET/POST calls, pagination, error handling, asynchronous requests, load handling 
  • Experience with MongoDB and pymongo 
  • Data visualization in Python a plus. 
  • Experience with CI/CD tools a plus but not required. 
  • Experience with linguistics or natural language processing a plus but not required.


Dice Id : 10216385
Position Id : 6798500
Originally Posted : 5 months ago
Have a Job? Post it

Similar Positions

Software Engineer (Data Pipelining)
  • Opal Soft, Inc.
  • Cupertino, CA, USA
Data Pipelining Software Engineer
  • Pinnacle Group
  • Cupertino, CA, USA
Data Pipelining Software Engineer
  • Rose International
  • Cupertino, CA, USA
Data Engineer
  • Open IT Labs LLC
  • Richmond, VA, USA
Data Engineer (Python and Airflow must)
  • IFLOWSOFT Solutions Inc.
  • New York, NY, USA
Data Engineer
  • Modis
  • Cupertino, CA, USA
Data Engineer in Cupertino, CA.
  • OSI Engineering, Inc.
  • Cupertino, CA, USA
Data Engineer with Airflow Python exp
  • Nutech Systems, Inc.
  • Denver, CO, USA
Azure Data Engineer
  • Indotronix International Corp
  • Mississauga, ON, Canada