W2 - Hybrid :: Senior Databricks Specialist With Strong AI & ML Exp.

Senior Databricks Specialist With Strong AI & ML Exp.

12+Months

Hybrid

Key Responsibilities:
- Develop and execute a data analytics framework that scales according to the evolving business requirements, emphasizing the Databricks ecosystem.
- Build, refine, and enhance extensive data processing pipelines to tackle intricate data analysis challenges.
- Converge and purify varying large-scale datasets to facilitate actionable intelligence, reporting, and advanced analytical use cases like AI and Machine Learning.
- Generate comprehensive business understanding by amalgamating disparate data streams (including sales, customer feedback, and online analytics) for a holistic view of organizational performance.
- Acquire, evaluate, and experiment with new datasets from internal and external open-source channels.
- Formulate and apply data stewardship protocols.
- Coordinate data engineering efforts and analytical tasks across different technical teams.
- Act as a liaison with the company's stakeholders, managing and organizing data exchanges and transfers.
- Contribute to the deployment, surveillance, and support of machine learning and artificial intelligence models.

Qualifications:
- Proven track record with several years of experience in roles that utilized the Databricks platform for resolving data engineering challenges.
- Proficiency in the foundational elements of the contemporary data landscape (including data storage, processing, governance, DataOps, and MLOps), with a keen focus on the capabilities of the Databricks ecosystem.
- Knowledgeable in data architecture and excels in designing and executing efficient ETL and ELT workflows within Databricks.
- Demonstrable expertise in SQL and Python programming languages.
- Insight into artificial intelligence and machine learning principles, along with hands-on experience in MLOps and DataOps on the Databricks framework.
- Preferably acquainted with MLFlow or comparable platforms.
- Practical experience with addressing data governance issues using Unity Catalog or analogous solutions within the Databricks context.
- Skilled at fine-tuning Databricks jobs for optimal performance.
- Exceptional problem-solving abilities coupled with an analytical mindset.
- Stellar communication skills, capable of dissecting, elucidating complex concepts, and presenting findings to a broad audience.
- A proactive disposition towards contributing ideas and challenging the normal paradigms to foster innovation and efficiency.