Databricks Consultant Capital Markets

About the Role
Our global professional services firm is seeking an experienced Databricks Consultant to join our Capital Markets practice. You will work on high-impact assignments, delivering modern analytics and large-scale data architecture solutions for trading, regulatory, and risk-focused environments.

Key Responsibilities

• Lead and deliver end-to-end implementations on the Databricks platform.
• Architect and deploy data lake and streaming solutions optimized for capital markets use cases.
• Design and manage real-time data pipelines using Kafka and Spark Streaming.
• Build and optimize ETL workflows for ingestion, cleansing, and transformation at scale.
• Ensure data governance, quality, and compliance across surveillance and reporting pipelines.
• Support deployment pipelines with CI/CD best practices and version control.
• Participate in code reviews, architecture discussions, and client workshops.
• Collaborate with stakeholders to ensure timely, successful project delivery.

Required Skills & Experience

• Deep expertise with Databricks, Apache Spark, and Data Lake architectures (Delta Lake preferred).
• Proven experience with Kafka, streaming pipelines, and real-time data processing.
• Proficiency in PySpark and SQL, with hands-on integration into Azure, AWS, or Google Cloud Platform.
• Experience with CI/CD workflows, Git-based version control, and production deployments.
• Familiarity with MLflow and Databricks ML tools for machine learning pipelines.
• Strong background in capital markets data trading, financial instruments, or regulatory reporting.
• Excellent communication, client-facing, and documentation skills.

Why Join Us?

• A strong pipeline of capital markets projects, working with leading global institutions.
• Exposure to cutting-edge data and analytics technologies.
• A collaborative culture that invests in training, career growth, and continuous learning.
• Competitive compensation, comprehensive benefits, and flexible work options.