Senior Data Engineer

Tableau, Hive, Technical, Amazon Web Services, Spark, Python, Logistic Regression, Statistics, Visualization Machine Learning, Parametric Modelling, Debian, Git, Software Engineering, SQL, Hadoop, Pyspark, Numpy, Pandas, Github, Aws
Full Time
Depends on Experience
Travel not required

Job Description


  • Perform data engineering tasks using PySpark to aggregate multiple data sources into a centralized repository on AWS
  • Maintain and improve machine learning models and PySpark based personalization/assignment/measurement tools
  • Develop new features, augment tools and create new models based on business requirements

Technical Qualifications:

  • Data Engineering & data flow pipelines (experience as a builder of new systems)
  • Software engineering skills (Pull requests, unit testing, automated model tests, etc)
  • Deep experience designing, executing, & measuring experiments
  • Experience w/ creating experiment results visualizations/reports & applying results to drive business value
  • Statistics knowledge (e.g. parametrized vs non-parametrized tests)
  • Modeling experience preferred (Uplift modeling, propensity score matching, Linear/Logistic Regression and other supervised and unsupervised algorithms)
  • Languages/Tools
  • Python (pandas, numpy)
  • SQL (analytic functions, subqueries, etc)
  • Git & Github
  • Spark (using pySpark)
  • Visualization (e.g. Tableau)
  • Hadoop: AWS EMR (Debian), Hive
  • Excel/PowerPoint

Dice Id : compexpr
Position Id : 5903684
Originally Posted : 1 year ago
Have a Job? Post it

Similar Positions

Data Scientist - ====ship REQUIRED
  • Job Juncture
  • Boston, MA
Senior Data Scientist - eCommerce
  • Huxley Banking & Financial Services
  • Boston, MA
Data Strategy & Solutions Senior Data Scientist
  • Vertex Pharmaceuticals Inc (US)
  • Boston, MA
Data Scientist
  • Technosoft Corporation
  • Boston, MA
Data Engineer (BOS) - Spark/SQL
  • Addison Group
  • Boston, MA
Senior Data Scientist
  • CyberCoders
  • Cambridge, MA
Data Analyst II
  • Select Source International
  • Burlington, MA
Sr Data Engineer - Boston, MA or Austin, TX
  • UnitedHealth Group
  • Boston, MA
Manager Data Analytics
  • Golden Resources. Inc.
  • Boston, MA
Data Engineer
  • Softpath System, LLC.
  • Boston, MA
Senior Data analyst
  • A2C Consulting
  • Boston, MA
Data Analyst
  • Applicantz, Inc.
  • Boston, MA
IT Control Data Analyst
  • Anuva Resource Solutions
  • Boston, MA