Data Engineer

SparkSQL, pySpark, bigdata, Azure
Full Time
$60,000 - $80,000

Job Description

Data Engineer

Livonia, MI

Full-Time

Or

Contract – 6 months with a possibility of extension

Soothsayer Analytics is seeking Senior Data Engineer who has an interest in solving challenging Big Data problems in Insurance. Our Data team works on a variety of exciting analytics (ML, AI) projects.

 

Required Education:

  • PhD in computer science, Physics, Statistics, applied Mathematics, or other quantitative/ Computational discipline or Master's with over 5 year of real time relevant real-time Industry experience as a Data Engineer/ Big data Engineer is a MUST.

 

Required experience: At least 5 years industry experience as a Data Engineer/ Big Data Engineer is required.

 

Job Description:

  • Participate in requirements gathering, technical specification, design and development of complex operationalizing machine learning projects.
  • Ability to translate business requirements into plausible technical solutions for articulation to other development team members.
  • Contribute to the architecture design, development of data or machine learning pipelines, and integration into enterprise systems
  • Responsible for Build and configure multi-tenant machine learning environments on-prem, cloud or hybrid
  • Having a passion for solving interesting and challenging big data problems
  • Communicate results to scientific and business stakeholders
  • Collaborate with other engineers, data scientists and business analysts.

 

 

Machine Learning Engineer/ Data Scientist

  • Experience in gathering and preparing rich data sets in insurance domain.
  • Experience in using tools like SparkSQL and pyspark to analyze data at scale.
  • Passion for designing and implementing clean, reproducible and automated pipelines.
  • Discover data sets, spot potential pain points and solutions/optimizations for faster processing of data.
  • Comfortable in working AWS Sagemaker
  • Familiarity with MLOps and DevOps practices
  • Keep up to speed on new and emerging technologies.
  • Experience with at least one CI/CD tool, e.g. Jenkins, Github actions, or cloud equivalents

 

Required Skills/ Skills Matrix:

  • Building pipelines using AWS SageMaker – 2 years - MUST
  • SparkSQL, pySpark – 5 years - Must
  • MLOps – 1 year - Must
  • Domain experience in building Insurance specific pipelines – 1 year Must

About Soothsayer Analytics

Soothsayer Analytics is a Data Science company based out of Livonia, MI and offices in Columbus, OH and offshore in Hyderabad India. Advanced Analytics firm focused on Pattern Recognition and Unstructured Data. Our team actively works with, creates, and researches cutting edge Data Science techniques. We approach each problem individually and architect custom solutions. Our strength lies in our ability to build and productize proprietary algorithms and analytical tools. Advised by 10 industry experts whose domain knowledge we leverage to better architect industry specific solutions. Our delivery partners include 20+ Data Scientists with a combined 75 Patents and 300+ Publications. We collaborate with this brain trust to keep us abreast of state-of-the-art techniques and to help deliver world-class results. We utilize cutting edge Machine Learning and Statistical Techniques to extract Hidden Insights and Patterns from Complex, High Dimensional, and Unstructured Data. Our major clients include: DOW Chemicals, Ford, Visteon, D&B, Timken, US steels, Steelcase, Abercrombie, Express, Stanley Steemer, Whirlpool, AEP, NiSource, GEA, etc.

Soothsayer Analytics is an Equal Opportunity Employer and E-Verify Company.

About Blue Icy Water

Blue Icy Water is an IT Consulting and Staffing firm. We specialize in Data Science/ Machine Learning, Big Data, Hadoop, Tableau but also have work in.NET, Java, QA, BA, PM, Oracle, SAP etc. Over the years we have successfully built strong relations placing our consultants. We have expertise in the Analytics domain.

Dice Id : 90744029
Position Id : 7074604
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

Machine Learning Engineer
  • Blue Icy Water, LLC
  • Livonia, MI, USA
Big Data Engineer (Hadoop, Spark)
  • Systems Technology Group Inc. (STG)
  • Dearborn, MI, USA
Machine Learning Engineer
  • Ciber Global LLC
  • Dearborn, MI, USA
Big Data Developer (Spark)
  • Systems Technology Group Inc. (STG)
  • Dearborn, MI, USA
GCP Data Engineer (100% Remote)
  • UNICOM TECHNOLOGIES INC
  • Dearborn, MI, USA
Big Data Hadoop Developer
  • Ciber Global LLC
  • Dearborn, MI, USA
Data protection Engineer(Google Data Protection)
  • Net2Source Inc.
  • Detroit, MI, USA
Application Architect
  • Systems Technology Group Inc. (STG)
  • Dearborn, MI, USA
Cloud Data Platform Engineer
  • J R D Systems Inc
  • Ann Arbor, MI, USA
Software Engineer
  • Ciber Global LLC
  • Dearborn, MI, USA