Overview
On Site
$60,000 - $80,000
Full Time
Skills
Azure
ADF
SQL & Python
Azure Databricks
Azure Blob Storage
Azure Data Lake & Azure Synapse Analytics
Data Integration & ETL
Big Data & Spark
SQL
Python
Numpy & Pandas
Azure Monitor
Job Details
.Key Skills:
Technical Skills:
- Programming and Scripting Languages:Proficiency in SQL, Python, and Java are crucial for data manipulation, transformation, and building data pipelines.
- Data Pipeline Development:Understanding and experience with building and managing data pipelines using Azure Data Factory, Azure Databricks, and other relevant tools.
- Data Storage:Knowledge of Azure Blob Storage, Azure Data Lake Storage, and Azure Synapse Analytics.
- Data Integration and ETL Tools:Experience with ETL (Extract, Transform, Load) processes and tools like Azure Data Factory and Azure Databricks.
- Big Data Technologies:Familiarity with Hadoop, Spark, and related technologies.
- Cloud Platform Skills:A strong understanding of Azure cloud services and their application in data engineering.
- Database Administration Skills:Knowledge of relational databases (like SQL Server) and other data storage technologies.
- :- Joins, CTEs, Window Functions, Indexing
- :- Pandas, NumPy, Error Handling, Logging
- :- DataFrames, RDDs, Transformations
.
- :- Blob Storage, ADLS Gen2
- :- Secrets Management, Access Control
- :- Data Warehousing, Dataflows
.
- :- ETL Pipelines, Data Flows
- :- Spark Clusters, Delta Lake, Notebooks
- :- Serverless SQL Pool, Dedicated SQL Pool
- Star Schema, Snowflake Schema, Slowly Changing Dimensions
- Data Partitioning Strategies
- Data Governance with Purview
- Azure Monitor & Log Analytics
- Performance Tuning in Synapse and Databricks
- Cost Management Strategies
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.