Azure Data Engineer

Overview

On Site
$60,000 - $80,000
Full Time

Skills

Azure Data Factory
Data Engineer
ETL/ELT
Azure Databricks
Azure Data Lake
Azure Synapse Analytics
Azure Cosmos DB
SQL
Python & PySpark
Data Modelling
Data Security
Hadoop

Job Details

Azure Cloud Services
  • Azure Data Factory:
    Building and managing robust ETL/ELT pipelines for data movement and transformation.
  • :
    Processing large datasets using Apache Spark for big data analytics and machine learning.
  • :
    Designing and implementing scalable data storage solutions for various data types.
  • :
    An integrated analytics service for big data and data warehousing.
  • Azure SQL Database & :
    Expertise in designing, implementing, and managing relational and non-relational databases in Azure.
Programming & Data Processing
  • :
    Essential for querying and managing structured data, including advanced functions, joins, and window functions.
  • :
    Used for scripting, automation, data manipulation with libraries like NumPy and Pandas, and integrating with services like PySpark.
  • & PySpark:
    A framework for distributed processing of large datasets, crucial for big data tasks.
  • :
    Designing and implementing Extract, Transform, and Load (ETL) or Extract, Load, Transform (ELT) processes to move and prepare data.
Data Architecture & Design
  • Data Modeling:
    Designing logical and physical data models to represent data effectively and support efficient querying.
  • Data Warehousing:
    Understanding data warehousing concepts, including star and snowflake schemas, and designing data warehouse solutions.
  • Data Security & Compliance:
    Implementing best practices for data security, encryption, access controls, and adhering to compliance regulations.
Big Data Technologies
  • Hadoop:
    Understanding the principles and components of big data technologies like Hadoop and their use in the Azure ecosystem.
  • Streaming Technologies:
    Knowledge of services like Azure Stream Analytics for real-time data processing.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.