Azure Databricks Engineer

Job Role: Azure Databricks Engineer

Job Location: Plano TX/ Cincinnati OH/ Indianapolis IN

Job Type: Full time

Job Description:

Client is seeking an Azure Databricks Engineer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will provide inputs for identifying best-fit architectural solutions for one or more projects; develop design of applications, provide regular support and guidance to project teams on complex coding and issue resolution with the objective of ensuring best-fit and high-quality technical solutions within the area of technology specialization and in compliance with guidelines, policies and norms of Infosys. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

Required Qualifications:

• Bachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 7 years of experience with Information Technology.
• Proven years of hands-on experience in architecting solutions on Azure, Databricks and Spark
• Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python.
• Familiarity with vector search and semantic retrieval for retail use cases.
• Expertise in data privacy and compliance in consumer-facing environments
• Good experience in end-to-end implementation of data warehouse and data marts
• Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design
• Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins
• Experience designing and implementing complex solutions for distributed systems
• Experience in leading and mentoring teams