Senior Data Engineer

Overview

On Site
Hybrid
Depends on Experience
Contract - W2
Contract - 6 Month(s)

Skills

Senior Data Engineer
Hadoop
Snowflake
Spark
Kafka
Trino
NoSQL
data lakes
Python
SQL
Unix
ETL
Tableau

Job Details

Senior Data Engineer

We are seeking a Senior Data Engineer to support cloud infrastructure cost management and capacity forecasting initiatives. This role focuses on building scalable, highly available data products and pipelines in a Hadoop and cloud-based data ecosystem, enabling data-driven FinOps and analytics decisions.

Responsibilities

  • Analyze, validate, and prepare data for ingestion, including governance and compliance reviews

  • Design, build, and maintain highly available data products, models, and data marts

  • Develop scalable ETL/ELT and streaming data pipelines

  • Support FinOps and capacity analytics through reliable data engineering solutions

  • Collaborate with cross-functional teams to enhance cloud and infrastructure cost management

  • Troubleshoot data quality, integration, and data currency issues to ensure accuracy and reliability

  • Contribute to documentation, operational procedures, and change management plans

Qualifications

  • 5+ years of hands-on experience with Python, SQL, and ETL development

  • 3+ years working in on-prem and cloud-based infrastructure environments (SaaS, IaaS, FinOps, analytics, or capacity planning)

  • Strong experience in Data Engineering and DevOps within analytics- or FinOps-focused teams

  • Proficiency in Python, SQL, Unix, and familiarity with Rust or similar languages

  • Experience with data platforms such as Hadoop, Snowflake, Spark, Kafka, Trino, NoSQL, and data lakes

  • Strong understanding of ETL/ELT, streaming architectures, CDC, SCD, data lineage, and orchestration tools (e.g., Apache Airflow)

  • Familiarity with CI/CD pipelines, automation tools (e.g., Jenkins), and Agile development practices

  • Experience building dashboards and insights using Tableau and Tableau Prep

  • Excellent written and verbal communication skills

  • Self-starter with the ability to work independently in a fast-paced environment

  • Strong team player with a collaborative mindset

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.