Sr Azure Data Engineers - Matillion and BigQuery

We are looking for a highly skilled Senior Data Engineer with strong experience in data pipeline development, ETL, data warehousing, and data architecture. The ideal candidate will have hands-on experience with Matillion and BigQuery, along with strong SQL and data engineering capabilities.

• Design, develop, test, and maintain scalable data pipelines and data management systems.
• Build ETL processes for extracting, transforming, and loading data from multiple sources.
• Integrate structured and unstructured data into unified data platforms.
• Ensure data quality, consistency, availability, and reliability.
• Build and maintain data warehouses and data lakes.
• Develop and optimize solutions using Google BigQuery.
• Work extensively with Matillion ETL for data integration and transformation.
• Optimize databases, queries, ETL processes, and data pipelines.
• Implement data processing solutions using technologies such as Hadoop and Spark.
• Automate manual processes and develop data monitoring mechanisms.
• Work with data scientists, analysts, architects, and business stakeholders.
• Troubleshoot data pipeline issues and improve overall data delivery.
• Design data models and contribute to data architecture initiatives.
• Optimize large-scale data processing and reduce pipeline execution times.

• 5+ years of experience as a Data Engineer or in a similar role.
• Bachelor's degree in Computer Science, Engineering, Information Technology, or related field.
• Strong proficiency in SQL, particularly Snowflake SQL.
• Hands-on experience with Matillion ETL.
• Strong experience with Google BigQuery.
• Experience with relational databases such as MySQL/PostgreSQL.
• Strong understanding of ETL/ELT processes.
• Experience with data warehousing and data architecture.
• Experience designing and optimizing scalable data pipelines.
• Good programming experience with Python.
• Knowledge of Hadoop/Spark or other distributed data processing technologies.
• Strong understanding of data modeling and data integration.

• Azure data engineering experience.
• Experience with cloud data platforms.
• Experience with large-scale data migration and integration.
• Strong troubleshooting and performance-tuning capabilities.