Overview
On Site
$60,000+
Full Time
Skills
Azure Services
Python
ETL
Data Engineering Concepts
Big Data
Spark & Hadoop
SQL/NoSQL
Data Quality & Testing
Data Security
Job Details
Core Technical Skills:
- Programming and Scripting: Proficiency in Python for data manipulation and scripting, as well as SQL for database interactions are essential. PySpark and Spark SQL are also beneficial for data processing.
- Azure Services: A strong understanding of core Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Database is crucial.
- Data Engineering Concepts: Solid grasp of data modeling, ETL (Extract, Transform, Load) processes, data ingestion, and transformation are fundamental.
- Big Data Technologies: Familiarity with big data technologies like Spark, and potentially Hadoop, is advantageous for handling large datasets.
Supporting Skills:
- Database Management: Knowledge of database administration skills and various database types (SQL and NoSQL) is important.
- Data Quality and Testing: The ability to ensure data accuracy and reliability through testing is vital.
- Data Security and Compliance: Understanding data security principles and compliance requirements is necessary for responsible data handling.
- Collaboration and Communication: Being able to effectively communicate technical information and work collaboratively in a team environment is highly valued.
- Continuous Learning and Adaptation: The technology landscape is constantly evolving, making the ability to learn and adapt to new tools and techniques essential.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.