Job Summary:
Overall 10 + Years of experience and 3+ years of experience Developing, deploying data solutions using AWS/Azure Data Bricks in PySpark
Responsible for developing, capturing, and sharing solution architecture patterns, and best-practices knowledge that can be applied across domains.
Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.
Work with global Data Standards, structures, and processes to maintain global guidelines
Experience with AWS Ecosystem and AWS S3
Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.
Hands-on expert with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions
Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc
Demonstrated strength in data management, orchestration, access control, etc.
A proven expert in writing optimized SQL to deal with large data volumes
Desirable to have knowledge on SAP ECC
Key Responsibilities:
Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.
Work with global Data Standards, structures, and processes to maintain global guidelines
Experience with AWS Ecosystem and AWS S3
Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.
Hands-on expert with real-time data processing and analytics, data ingestion (batched and
streamed), and data storage solutions
Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc
Demonstrated strength in data management, orchestration, access control, etc.
Required Skills:
Databricks
Preferred Qualifications:
the required qualification is primarily a combination of Databricks data engineering, SQL, Python, Azure data services, and foundational architecture skills.