Microsoft Azure Data Engineer

Full time regular position with Salary up to $150K/yr + excellent benefits and perks

Minimum of five years of Azure migration experience.

Our client, a reputed financial institution, is looking for a Cloud Data Engineer, responsibilities include designing, implementing, and managing data solutions on Microsoft Azure and other cloud platforms. Oversee the creation and maintenance of data pipelines, storage solutions, processing, analysis, and integration to facilitate data-driven decision-making. This role requires a combination of technical skills, analytical problem-solving, and collaboration with cross-functional teams to achieve data-driven goals.

Key Responsibilities

• Design and implement scalable and secure data processing pipelines and storage environments using cloud services and tools
• Collaborate with technical analysts, business analysts, and line of business stakeholders to understand data requirements and implement appropriate data solutions
• Ensure data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements
• Build effective data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
• Load transformed data into storage and reporting structures in destinations including data warehouse, reporting systems and analytics applications
• Monitor and troubleshoot issues with the data environment to maintain high availability and performance
• Provide on-call support for critical production systems
• Implement data security measures, including encryption, access controls, and auditing, to protect sensitive information
• Utilize analytics services to provide actionable insights and support data-driven decision-making
• Maintain effective documentation regarding data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards
• Mentor IT staff on security best practices and emerging technologies
• Participate in continuous learning to stay current with cybersecurity advancements
• Collaborate with colleagues to draft technology plans that enhance security posture
  
  

Minimum Qualifications: Knowledge, Skills and Abilities

• Previous experience as an Azure Data Engineer or similar role
• Proven experience using data processing languages such as Python and SQL
• Experience with Azure: Data Factory, Databricks, Data Lake Storage, SQL DW, Analysis Services, and API - PySpark
• ETL experience in a data warehouse environment using slowly changing dimensions
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets
• Ability to multi-task in a fast-paced environment
• Ability to prioritize tasks and projects using a browser -based tracking system
• Familiarity with JIRA preferred
• Current knowledge of laws, rules, and regulations pertaining to information technology relating to financial institutions
• Ability to work independently with limited supervision
• Ability to effectively interact and communicate with outside vendors and internal clients
• Ability to communicate effectively both verbally and in writing
• Ability to establish and maintain effective working relationships with a diverse group of people
  
  

Licenses and Certifications

• Microsoft Certified Azure data engineer preferred
  
  

The ideal candidate has a combination of education and experience equivalent to a bachelor’s degree in computer science or closely related field and a minimum of five years of Azure migration experience.