Senior Data Engineer

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

data engineer
data engineering

Job Details

Job Title: Senior Data Engineer
Location: Kirkland, WA / Hybrid (3days a Week)
Must haves:
Proficient in programming languages like Python, SQL, Rust, and shell scripting to build and support automations and data products.
Skilled in working with both on-site and cloud-based data storage solutions, including Hadoop, Snowflake, NoSQL, and others.
Knowledgeable about data processing and pipeline concepts, such as ETL, ELT, and tools like Apache Airflow.
Understanding of GitOps and CI/CD best practices and tools like Jenkins, as well as agile development.
Experienced in managing and creating data insights and dashboards using Tableau
Backgrounds/skills can we be more flexible with that can be learned on the job?
ServiceNow Platform and API integrations
Homegrown Ingestion pipelines
Duties: Role Overview:
The FinOps Tools team is seeking a Senior Data Engineer. Your role will involve analyzing and preparing data for ingestion, developing new and supporting existing highly available data products, models, and data marts in a Hadoop environment.
Your work will drive Client's' FinOps Cloud Infrastructure Cost Management as well as Capacity Forecasting decisions.
What you get to do in this role:
  • Analyze and prepare data for ingestion, including data governance and compliance reviews to support various analytics initiatives.
  • Develop and maintain highly available data products, models, and data marts.
  • Collaborate with cross-functional teams to drive Cloud and Infrastructure Cost Management capabilities.
  • Support FinOps and Capacity Analytics through data engineering solutions.
  • Troubleshoot data currency and integration issues to ensure data reliability and accuracy.
Skills: In order to qualify for and be successful in this role, you should have:
  • 5+ years of demonstrated end-to-end Python, SQL, and ETL tool development to automate and accelerate data acquisition, manage data products, transformations, enrichment, and data pipelines at scale.
  • 3+ years of experience working with on-premises and cloud-based infrastructure services such as SaaS, IaaS, FinTech, capacity planning, supply chain, or data analytics environments.
  • Extensive experience in Data Engineering and DevOps within a data, FinOps or analytics-focused organization.
  • Strong programming skills in Python, SQL, Rust, Unix programming, and similar languages.
  • Experience working with on-premises and cloud data warehouse, DBMS, data lake platforms, technologies, most specifically Hadoop, Snowflake, NoSQL, HDFs, Spark, Kafka, Trino, etc.
  • Familiarity with data transformations, data pipeline concepts, including ETL, ELT, streaming, Lambda, and patterns such as change data capture, SCD, lineage, and orchestration tools such as (e.g., Apache Airflow, or similar).
  • Familiarity with CI/CD best practices and automation tools such as Jenkins and agile development environments.
  • Experience with developing data insights and dashboards using Tableau and Tableau Prep.
  • Excellent written and verbal communication skills, willing to prepare knowledge base, operational procedures, and change plans.
  • Experience working with the ServiceNow platform, data management frameworks, and API's is a plus.
  • Ability to work independently, execute with agility, and learn in a fast-paced environment.
  • Exceptional team player with a collaborative mindset.
Education:
Bachelor's degree in Computer Science, Data Science, Management Information Systems, Mathematics, or a related field. Equivalent work experience is also acceptable for the position
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.