Minimum Requirements:
Candidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity. |
Years | Required/Preferred | Experience |
8 | Required | Implement ETL/ELT workflows for both structured and unstructured data |
8 | Required | Collaborate with cross-functional teams including data scientists, analysts, and stakeholders |
8 | Required | Design and maintain data models, schemas, and database structures to support analytical and operational use cases |
8 | Required | Implement data validation and quality checks to ensure accuracy and consistency |
8 | Required | Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging |
8 | Required | Implement data security measures, including encryption, access controls, and auditing; ensure compliance with regulations and best practices |
8 | Required | Working in agile, multicultural environments |
4 | Required | Automate deployments using CI/CD tools |
4 | Required | Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses |
4 | Required | Proficiency in Python and R programming languages |
4 | Required | Strong SQL querying and data manipulation skills |
4 | Required | Experience with Azure cloud platform |
4 | Required | Experience with DevOps, CI/CD pipelines, and version control systems |
4 | Required | Strong troubleshooting and debugging capabilities |
3 | Required | Design and develop scalable data pipelines using Apache Spark on Databricks |
3 | Required | Optimize Spark jobs for performance and cost efficiency |
3 | Required | Integrate Databricks solutions with cloud services (Azure Data Factory) |
3 | Required | Ensure data quality, governance, and security using Unity Catalog or Delta Lake |
3 | Required | Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL |
3 | Required | Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake |
2 | Required | Build AI accelerators and reusable components to boost development teams’ productivity. |
2 | Required | Implement Gen AI / LLM application and utilities (Agentic AI, Harness / Prompt engineering, RAG) |
2 | Required | Implement AI application governance, observability and evaluation framework |
2 | Required | Design & Implement vector stores for knowledge bases and agent memory |
2 | Required | Integrate AI applications / utils / tools with enterprise traceability and SIEM tools |
2 | Required | Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow) |
1 | Preferred | Databricks Certified Associate Developer for Apache Spark |
1 | Preferred | Azure Data Engineer Associate |
Never miss an opportunity! Create an alert based on the job you applied for.
