Senior Data Engineer

We are seeking a Senior Data Engineer to support cloud infrastructure cost management and capacity forecasting initiatives. This role focuses on building scalable, highly available data products and pipelines in a Hadoop and cloud-based data ecosystem, enabling data-driven FinOps and analytics decisions.

Responsibilities

• Analyze, validate, and prepare data for ingestion, including governance and compliance reviews

• Design, build, and maintain highly available data products, models, and data marts

• Develop scalable ETL/ELT and streaming data pipelines

• Support FinOps and capacity analytics through reliable data engineering solutions

• Collaborate with cross-functional teams to enhance cloud and infrastructure cost management

• Troubleshoot data quality, integration, and data currency issues to ensure accuracy and reliability

• Contribute to documentation, operational procedures, and change management plans

Qualifications

• 5+ years of hands-on experience with Python, SQL, and ETL development

• 3+ years working in on-prem and cloud-based infrastructure environments (SaaS, IaaS, FinOps, analytics, or capacity planning)

• Strong experience in Data Engineering and DevOps within analytics- or FinOps-focused teams

• Proficiency in Python, SQL, Unix, and familiarity with Rust or similar languages

• Experience with data platforms such as Hadoop, Snowflake, Spark, Kafka, Trino, NoSQL, and data lakes

• Strong understanding of ETL/ELT, streaming architectures, CDC, SCD, data lineage, and orchestration tools (e.g., Apache Airflow)

• Familiarity with CI/CD pipelines, automation tools (e.g., Jenkins), and Agile development practices

• Experience building dashboards and insights using Tableau and Tableau Prep

• Excellent written and verbal communication skills

• Self-starter with the ability to work independently in a fast-paced environment

• Strong team player with a collaborative mindset