Overview
On Site
Depends on Experience
Full Time
100% Travel
Skills
API
Google Cloud Platform
DevOps
DevSecOps
Data Engineering
Cloud Computing
Kubernetes
Machine Learning Operations (ML Ops)
Machine Learning (ML)
Job Details
Miracle Software Systems Inc. is seeking a Data Engineer for one of our clients at our Novi, MI location. The candidate must have experience with Google Cloud Platform (Cloud Run), DevOps, or DevSecOps tools, as well as MLOps skills. This is an ONSITE position atthe MI location. Kindly let me know your availability for this position and share any referrals if you have.
Position: Data Engineer
Location: Novi, MI
Primary Skills:
Google Cloud Platform Cloud Run, Kubernetes, Spark, SonarQube, Google Cloud Platform, Google Cloud Platform, Tekton, Python, API, Jira
Summary:
We are seeking an experienced Data Engineer to design, implement, and maintain robust analytics pipeline solutions. These solutions will support the analysis, modeling, and prediction of upstream and downstream auction prices, directly benefiting the Business and Sales Planning Analytics (BSPA) Used Vehicle Analytics team and its customers. The ideal candidate will excel at developing solutions, maintaining DevSecOps, and collaborating with cross-functional teams to improve processes and drive business performance.
Key Responsibilities:
1) Collaborate with business and technology stakeholders to understand current and future data requirements
2) Design, build and maintain reliable, efficient and scalable data infrastructure for analytics models, data collection, storage, transformation, and monitoring
3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable workflow
4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
6) Ensure optimum performance and identify improvement opportunities
Responsibilities:
Develop, build and maintain infrastructure required for analytics, including data pipelines, model deployment platforms, and model monitoring.
Develop and maintain tools and libraries to support the development and deployment of models.
Automate machine learning workflows using DevSecOps principles and practices.
Collaborate with development and operations teams to implement software solutions that improve system integration and automation of analytic pipelines.
Design, develop, and manage data flows and APIs between upstream systems and applications.
Troubleshoot and resolve issues related to system communication, data flow, and data quality.
Collaborate with technical and non-technical teams to gather integration requirements and ensure successful deployment of data solutions.
Create and maintain comprehensive technical documentation of software components.
Work with IT to ensure systems meet evolving business needs and comply with data governance policies and security requirements.
Implement and enforce the highest standards of data quality and integrity across all data processes.
Manage deliverables through project management tools.
Experience Required:
Engineer 2 Exp: 4+ years Data Engineering work experience AWS
Experience Preferred:
5+ years of experience in the automotive industry, particularly in auto remarketing and sales.
Master's degree in a relevant field (e.g., Computer Science, Data Science, Engineering).
Proven ability to thrive in dynamic environments, managing multiple priorities and delivering high-impact results even with limited information.
Exceptional problem-solving skills, a proactive and strategic mindset, and a passion for technical excellence and innovation in data engineering.
Demonstrated commitment to continuous learning and professional development.
Familiarity with machine learning libraries, such as TensorFlow, PyTorch, or Scikit-learn Experience with MLOps tools and platforms.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.