Azure Synapse Data Engineer

Job Title: Azure Synapse Data Engineer



Role Type: 12+ Month ctr



Location: San Antonio, TX (4 days onsite)






Position Summary: Data Engineering group is seeking a Senior Data Engineer to join our team. The Data Engineer will play a key role in building and maintaining end-to-end data pipelines for analytics solutions within company Insights & Discovery Platform, based on Microsoft Azure Cloud and Azure Synapse Analytics.



Key Responsibilities:



Design, develop, and implement analytics solutions on the Microsoft Azure Synapse Analytics Platform.



Develop ETL/ELT processes to collect and integrate data from various sources, ensuring data quality and pipeline performance for large volume data ingestion.



Utilize data preparation, integration, storage, and analytics tools within the Azure landscape.



Drive automation of repeatable data preparation tasks to minimize manual data management processes.



Partner with business unit IT teams to gather and document analytics solution requirements.



Document and provide solution options and recommendations for analytics solutions.



Collaborate with cloud service providers, data science, data governance, and other IT and business teams to deliver analytics solutions.



Participate in MPC's scaled agile framework for data engineering product delivery by engaging in all relevant tasks and ceremonies.



Provide troubleshooting, analysis, and resolutions for existing solutions, including routine production support issues and major/minor enhancements.



Education and Experience:



Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, or a related field.



Minimum of 8-10 years of hands-on experience in building data pipelines, data models, and maintaining/supporting enterprise data warehouse solutions.



Experience in scaled agile framework for data engineering product delivery.



Microsoft Azure certifications in various analytics technologies are a plus.



Working knowledge/familiarity with Oil & Gas industry processes is a plus.



Skills:



Strong SQL experience, data modeling, data warehouse, and OLAP concepts.



Experience with Azure Data Lake Storage, Azure Synapse Analytics, Azure Spark Pools, Databricks Notebook, Cosmos DB, CDC tools, Python, DevOps, CI/CD.



Familiarity with data integration tools (e.g., Qlik Replicate) and data modeling tools (e.g., Erwin) is a plus.



Familiarity with data lake medallion architecture and concepts of Unified Data Models.



Familiarity with contextualization products (e.g., Cognite) is a plus.



Experience with visualization tools such as Microsoft PowerBI and Tableau is desired.



Familiarity with Scaled Agile, DevOps, Scrum, and ITIL concepts is a plus.



Experience with Microsoft SSIS, SSRS, SSAS is a plus.



Competencies:



Strong communication and presentation skills Ability to present and communicate with technical and non-technical stakeholders at different levels within IT and business departments during various stages of solution design, development, and implementation.



Collaboration & Building Partnerships Developing and leveraging relationships within and across work groups to achieve results.



Drive for Results Taking ownership of assigned work and prompt action to accomplish objectives; taking actions to achieve goals beyond what is required; being proactive.



Continuous Improvement Originating actions to improve existing conditions and processes, identifying improvement opportunities, generating ideas, and implementing solutions.