ADB and Pyspark Developer

We are seeking a skilled ADB and Pyspark Developer to join our team. The role involves designing, developing, and maintaining scalable and efficient data processing solutions using Azure Data Bricks and Pyspark. You will play a crucial role in optimizing data workflows and contributing to our data-driven decision-making processes.
Responsibilities

• Develop and maintain data processing pipelines using Azure Data Bricks and Pyspark.
• Collaborate with data engineering and analytics teams to integrate data solutions.
• Optimize and troubleshoot data workflows to ensure efficiency and reliability.
• Implement best practices for data management and processing.
• Ensure data quality and integrity across all data pipelines.

Qualifications

• Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
• Minimum of 5 years of experience in data engineering or related roles.
• Proficiency in Azure Data Bricks and Pyspark.
• Strong understanding of distributed data processing frameworks.
• Excellent problem-solving and analytical skills.
• Ability to work collaboratively in a team environment.
• Strong communication skills to convey complex technical concepts.

Preferred Skills

• Experience with cloud platforms such as Azure, AWS, or Google Cloud.
• Familiarity with big data technologies and data warehousing solutions.
• Knowledge of SQL and database management systems.
• Understanding of data security and compliance practices.

Experience

• A minimum of 5 years of relevant experience in data engineering, with a focus on Azure Data Bricks and Pyspark.