Azure Data Engineer

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
50% Travel

Skills

ASA
Agile
Alteryx
Analytics
Apache Cassandra
Apache Spark
Business Intelligence
Cloud Computing
Collaboration
Computer Engineering
Computer Science
Continuous Delivery
Continuous Integration
Continuous Integration and Development
Data Analysis
Data Engineering
Data Governance
Data Lake
Data Management
Data Migration
Data Modeling
Data Warehouse
Databricks
Datastage
DevOps
EDC
GitHub
Grafana
IBM Cognos Analytics
IBM InfoSphere DataStage
IT Management
Informatica
Information Systems
Jenkins
Management Information Systems
Microsoft Azure
Microsoft Power BI
MongoDB
Network Security
PL/SQL
Performance Tuning
Privacy
Python
SQL
Scripting
Snow Flake Schema
Software Development
Storage
Streaming
Tableau
Teradata
Terraform
Testing
Training
Unix

Job Details

Job Title:- Azure Data Engineer

Location:- Irving, TX

Job Responsibilities

  • Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions.
  • Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools.
  • Perform multiple aspects involved in the development lifecycle - design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support.
  • Provide technical leadership and collaborate within a team environment as well as work independently.
  • Be a part of a DevOps team that completely owns and supports their product.
  • Implement batch and streaming data pipelines using cloud technologies.
  • Leads development of coding standards, best practices and privacy and security guidelines.
  • Mentors others on technical and domain skills to create multi-functional teams.

Minimum Qualifications- Education & Prior Job Experience

Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training.

  • 4+ years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
  • 5+ years data analytics experience using SQL.
  • 3 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
  • Combination of Development, Administration & Support experience in several of the following tools/platforms required:
  • Scripting: Python, Spark, Unix, SQL.
  • Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, Azure Data Explorer. Administration skills a plus.
  • Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions.
  • CI/CD: GitHub, Jenkins, Azure DevOps, Terraform.
  • BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana.
  • Data Warehousing: DataStage, Informatica.
  • Data Governance and Privacy: Informatica Axon and EDC, BigID.

Preferred Qualifications- Education & Prior Job Experience

6+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.

  • 6+ years data analytics experience using SQL.
  • 4+ years full-stack development experience, preferably in Azure.
  • 4+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.

Skills, Licenses & Certifications

Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers.

  • Expertise in providing practical direction within the Azure Native cloud services.
  • Azure Development Track Certification
  • Spark Certification
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.