Title: Solution Architect
Location: Dublin, Ohio (Hybrid)
Duties: We are looking for a Databricks Platform Expert with extensive experience in end-to-end Databricks implementations who can act as a Solution Architect. This role will lead the design, architecture, and deployment of Databricks-based solutions, ensuring best practices for scalability, security, and performance.
Key Responsibilities
Solution Architecture & Design
Define and implement Databricks architecture for enterprise-scale data platforms.
Design data lakehouse solutions leveraging Databricks capabilities.
Establish best practices for cluster management, job orchestration, and cost optimization.
Implementation & Integration
Lead end-to-end Databricks platform setup, including workspace configuration, security, and governance.
Integrate Databricks with cloud services (Azure/AWS/Google Cloud Platform) and enterprise data sources.
Develop data pipelines, ETL/ELT workflows, and optimize performance for large-scale workloads.
Collaboration & Leadership
Act as a technical advisor to stakeholders and guide teams on Databricks adoption.
Provide solution blueprints, architecture diagrams, and documentation.
Ensure compliance with data governance, security, and regulatory standards.
Required Qualifications
· 10+ years of experience in data engineering, analytics, or platform architecture.
· Extensive hands-on experience with Databricks, including:
o Workspace setup and administration.
o Cluster configuration and optimization.
o Job scheduling and orchestration.
· Proven track record of end-to-end Databricks implementations in enterprise environments.
· Strong understanding of data lakehouse architecture, Medallion architecture, and cloud-native data platforms.
· Expertise in Spark, SQL, and Python for data processing.
Skills: Preferred Skills
· Experience with Azure Databricks, AWS Glue, or Google BigQuery.
· Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code.
· Familiarity with data security frameworks and cost optimization strategies.
Never miss an opportunity! Create an alert based on the job you applied for.
