We are seeking a highly skilled Senior Architect with deep expertise in Databricks SQL, PySpark, and modern cloud data platforms. The ideal candidate will have hands-on experience delivering cloud modernization and migration initiatives, along with the ability to design and optimize scalable data architectures that support analytics, data engineering, and enterprise-scale processing.
This role involves leading architectural design, guiding engineering teams, and ensuring data solutions meet performance, security, and governance standards.
Key Responsibilities :
Design and implement scalable, high performance data architectures using Databricks Lakehouse, Delta Lake, and distributed processing frameworks.
Develop, optimize, and productionize Databricks SQL and PySpark pipelines supporting large-scale ETL, streaming, and advanced analytics workloads.
Lead end-to-end architecture for cloud modernization and migration projects, ensuring best practices in scalability, performance, governance, and cost efficiency.
Collaborate with business partners, product owners, and engineering teams to convert business requirements into robust technical solutions.
Provide technical leadership and mentorship to data engineers and developers, ensuring adherence to coding, design, and architectural standards.
Review and improve solution designs, ensuring alignment with enterprise governance, security, and compliance frameworks.
Support production deployments, troubleshooting, and performance tuning of data workflows running on Databricks and cloud-native platforms.
Drive continuous improvement and adoption of emerging technologies, tools, and best practices within the data engineering ecosystem.
Required Technical Skills:
Strong hands-on expertise with Databricks SQL
Advanced development experience with PySpark for ETL and data processing
Proven ability to design large-scale, distributed data architectures
Strong understanding of cloud-native data platforms (AWS, Azure, or Google Cloud Platform)
Solid foundation in data modeling, performance optimization, and governance
Never miss an opportunity! Create an alert based on the job you applied for.
