AI ML Data Architect

Need 15+years Experience

AI ML Architect with AWS Databricks

Key Responsibilities

Data Science & Machine Learning

· Develop, train, and optimize machine learning and statistical models using Databricks, Python, PySpark, and MLflow.

· Perform exploratory data analysis (EDA) to identify trends, patterns, and insights in large datasets.

· Deploy ML models into production using Databricks MLflow, Delta Live Tables, or other MLOps pipelines.

· Conduct A/B testing, forecasting, segmentation, anomaly detection, or recommendation systems as required by the business.

Data Engineering & Databricks Platform

· Build scalable, high-performance ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.

· Work with Delta Lake to ensure high-quality, reliable, and performant data.

· Optimize cluster usage and job performance within the Databricks environment.

· Collaborate with data engineers to ensure high-quality data availability for modeling.

Business Collaboration

· Translate business problems into analytical solutions and present findings to non-technical stakeholders.

· Partner with product, engineering, and business teams to drive data-informed decisions.

· Communicate complex statistical concepts in a clear and concise manner.

Skills & Qualifications

Required

· Bachelor’s degree or higher in Computer Science, Data Science, Mathematics, Statistics, Engineering, or related field.

· 3+ years of experience in data science or machine learning roles.

· Advanced knowledge of Databricks, including:

o PySpark / Spark SQL

o Databricks notebooks

o Delta Lake

o MLflow

o Databricks Jobs & Workflows

· Strong programming skills in Python (pandas, numpy, scikit-learn).

· Experience working with large-scale data processing.

· Solid understanding of machine learning algorithms and statistical techniques.

Preferred

· Experience deploying models in production using MLOps frameworks.

· Knowledge of Azure Databricks or AWS Databricks environments.

· Understanding of CICD pipelines and DevOps concepts (Azure DevOps, GitHub Actions, etc.)

· Familiarity with deep learning frameworks (TensorFlow, PyTorch) is a plus.

Key Competencies

· Strong analytical and problem-solving skills

· Ability to work in a fast-paced, collaborative environment

· Excellent communication and presentation skills

· Self-driven with high attention to detail