Azure Databricks Architect - Databricks

Job Description:

We are seeking a highly skilled Azure Data Architect with strong expertise in Databricks to join our team for a strategic role within a leading financial services firm in New York. The ideal candidate will bring in-depth experience in building scalable, secure, and high-performance data solutions on Azure, with a proven track record in the credit card or payments domain.

Key Responsibilities:

• Design and implement scalable data architecture solutions using Azure Data Services and Databricks.

• Lead the end-to-end design and implementation of data pipelines, data lakes, and analytics platforms.

• Collaborate with business stakeholders, data engineers, and analysts to translate business needs into technical architecture.

• Optimize data workflows and ensure data quality, governance, and security compliance.

• Provide architectural oversight and guidance to development teams.

• Drive best practices in credit card transaction processing, fraud detection models, and customer behavior analytics.

• Integrate data from multiple sources including on-prem systems, cloud storage, and third-party APIs.

Required Skills:.

• Strong hands-on experience with Azure Databricks, Delta Lake, Azure Data Factory, Azure Synapse, Azure Blob Storage, and Azure SQL/Data Lake.

• Deep understanding of credit card domain including transaction lifecycle, authorization, settlement, fraud prevention, and risk scoring.

• Strong knowledge of data modeling, ETL/ELT processes, data warehousing, and data governance.

• Proficiency in Spark, Python, SQL, and CI/CD pipelines in a cloud environment.

• Experience with CI/CD tools, DevOps practices, and version control (Git).

• Excellent communication, stakeholder management, and leadership skills.