Overview
Skills
Job Details
Role Summary:
We are seeking a Solution Architect to lead the technical strategy and architecture for this migration. This role will be responsible for designing the future-state data platform using Azure Databricks, guiding data modeling, and ensuring seamless integration of multiple data sources including Oracle, SQL Server, and APIs.
Key Responsibilities:
Lead architectural design and strategy for migrating legacy systems to a Delta Lakehouse on Azure Databricks.
Collaborate with stakeholders to define business requirements and translate them into scalable technical solutions.
Design and implement medallion architecture (Bronze, Silver, Gold layers) for structured data processing.
Develop data models and decision tree logic to support equipment request validation.
Guide migration strategies for Oracle, SQL Server, and API sources, including ingestion patterns and transformation logic.
Oversee ELT pipeline design and ensure alignment with Databricks best practices.
Ensure architectural integrity, performance, and scalability throughout the project lifecycle.
Contribute to documentation including solution architecture, data flow diagrams, and optimization recommendations.
Required Skills & Experience:
Proven experience designing solutions on Azure Databricks and Delta Lake.
Strong understanding of lakehouse architecture, data modeling, and Spark-based ELT.
Experience with Azure Data Factory, Azure Data Lake Storage Gen2, and Unity Catalog.
Familiarity with ingesting and transforming data from Oracle, SQL Server, and REST APIs.
Ability to lead cross-functional teams and communicate effectively with technical and non-technical stakeholders.
Preferred Qualifications:
Experience with Databricks SQL, notebooks, and cluster configuration.
Knowledge of data governance, security, and compliance frameworks.
Prior experience in oil & gas or industrial data environments.
Agile/Scrum familiarity.