Platform (Data/Ops) Engineer

  • Minneapolis, MN
  • Posted 6 days ago | Updated 6 days ago

Overview

Hybrid
$40 - $50
Contract - W2

Skills

Analytics
Business Rules
Cloud Computing
Collaboration
Computer Science
Continuous Integration
Data Integration
Data Processing
Data Quality
Databricks
DevOps
Extract
Transform
Load
Issue Resolution
MVP
Microsoft Azure
Microsoft Power BI
POC
Product Development
Programming Languages
Python
R
Regression Testing
Regulatory Compliance
Reporting
Research
Root Cause Analysis
SAS
SQL
Snow Flake Schema
Training

Job Details

echnical Platform Operations

  • Automate admin tasks with Python and SQL for APIs and CLIs to enhance the data platform
  • Collaborate with technical staff to optimize their environments
  • Manage cloud platforms like Snowflake, Databricks, Qlik, Event Hubs, Power BI, and other Azure services
  • Create notification solutions to ensure cloud platforms are operational
  • Install patches and upgrades
  • Support issue resolution and escalation
  • Report on business metrics of the platform (adoption, goals alignment, product team needs)
  • Develop custom DevOps capabilities when not built-in
  • Engage with vendors to learn new platform capabilities
  • Set platform standards
  • Measure data pipeline compliance and platform uptime
  • Participate in MVP and PoC activities to explore new tech capabilities
  • Perform root cause analysis for issues
  • Implement data quality checks and monitoring systems based on source data gaps and business rules.
  • Redesign compute clusters to optimize costs and ensure workload isolation.
  • Provide cost monitoring and visibility tools to track and report on cloud platform compute expenses.

Product Development Operations

  • Communicate with technical staff
  • Automate release processes for data applications
  • Implement frameworks for varied data ingestion
  • Resolve technical and process issues
  • Document processes and onboard new engineers
  • Measure and report cloud platform usage


Improve Interoperability

  • Communicate platform status to technical product team members
  • Develop regression testing solutions to ensure alignment across various teams and prevent conflicting implementations on the platform
  • Collaborate effectively with cross-functional IT stakeholders to develop DevOps solutions
  • Proactively communicate potential risks across functions

Required Experience/Education

  • College or Vocation Training in Computer Science, Programming, or similar technical areas.
  • Or 1 2 years work experience in data processing, programming languages (SQL, Python, SAS, R, etc.), infrastructure, dev ops, etc.. This could experience could be in school or a work environment.

Required Competencies/Skills

  • Proficiency in modern data platforms (Snowflake, Databricks, Power BI, Qlik Data Integration)
  • Basic technical knowledge and understanding of data processing
  • Understanding and applying data quality principles
  • Identifying potential technical issues and risks
  • Collaborating across all levels and areas of the data platform team and analytics teams
  • Participating in PoC efforts to research emerging technologies
  • Working closely with technical personnel, including hands-on implementation
  • Proficiency in Python and SQL
  • Tech-focused career enthusiasm
  • Experience with CI/CD

Preferred Experience/Education

  • Post High School college or tech training

Preferred Competencies/Skills

  • Knowledge of infrastructure as code
  • Adaptability to a fast-paced environment
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.