Role: FINOPS DATA ENGINEER

Role: FINOPS DATA ENGINEER

Location: REMOTE

Duration: Long-term/Fulltime

Implementation Partner: Infinite Computer Solutions

Roles and responsibilities:

FINOPS DATA ENGINEER

Overview The FinOps Data Engineer is a key member of the BSI Enterprise Platform team focused on unlocking the value of cloud and platform cost data. This role is dedicated to acquiring, organizing, and optimizing financial datasets to provide transparency, enable accurate forecasting, and support data-driven decision-making for cloud and analytics spending. This position concentrates on the data pipelines, transformations, and reporting layers that streamline cost and usage visibility.

---

Key Responsibilities

Financial Data Acquisition & Pipeline Development

• Design, develop, and maintain data ingestion pipelines that gather cloud cost, usage, and billing data (e.g., AWS Cost and Usage Reports, Databricks cost metrics) into centralized Unity Catalog tables.
• Integrate data from multiple systems to build a unified cost dataset.
• Ensure pipelines are automated, scalable, and optimized for performance, cost, and data quality.

Data Modeling & Transformation

• Build robust data models in Databricks and SQL that transform raw billing and consumption data into clean, consumable datasets for stakeholders.
• Apply aggregation, normalization, and enrichment techniques to align technical cost data with finance reporting standards (e.g., cost centers, budgets, projects, products).
• Collaborate with data analysts to design semantic layers and curated views that support self-service analytics.

Forecasting & Analytics Enablement

• Create and maintain datasets and APIs that feed forecasting models and scenario-planning tools.
• Partner with FinOps, Product, and Engineering teams to improve forecast accuracy by providing reliable historical trends and usage patterns.
• Support visualization and reporting in BI tools to surface trends, anomalies, and cost optimization opportunities.

Monitoring, Data Quality, & Governance

• Implement data quality checks, validation routines, and reconciliation processes between source systems and financial reports.
• Work with governance and compliance teams to ensure alignment with corporate data security and privacy standards.
• Maintain detailed technical documentation for all datasets, pipelines, and transformation logic.

Collaboration & Stakeholder Engagement

• Serve as the bridge between FinOps, Platform, and Engineering teams translating financial needs into technical solutions.
• Present cost insights, trends, and recommendations to business and technical leadership.
• Contribute to FinOps best practices, processes, and playbooks for cost data handling.

---

Required Skills & Experience

• Strong experience with Python, SQL, and data pipeline orchestration, Databricks Workflows preferred.
• Proficiency in AWS data services and working knowledge of Databricks.
• Understanding of cloud billing data structures (preferably AWS) and cost optimization principles.
• Experience with data modeling, transformation, and performance tuning for analytics.
• Familiarity with BI tools for dashboard development and reporting. Experience with Databricks AI/BI and Genie spaces is a plus.
• Excellent communication skills, with the ability to simplify complex cost data for diverse audiences.

Preferred Qualifications

• Exposure to FinOps principles and practices.
• Experience integrating financial data with planning/forecasting tools.
• Knowledge of cloud cost allocation tagging strategies and anomaly detection methods.
• Background in large-scale, multi-account AWS environments.