Azure Cloud Data Engineer
Ideate Technologies LLC
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Microsoft Azure services
- cloud architecture
- and cloud computing.
- Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics Azure SQL Database Azure Data Lake Storage (ADLS)
- Python
- PySpark
- Spark
- SQL
- Scala
- Java
- and Hive.
- Virtual Machines
- Databricks
Summary
Mandatory Skills & Requirements
- Strong knowledge of Microsoft Azure services, cloud architecture, and cloud computing.
- Experience with Azure data services, including:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure SQL Database
- Azure Data Lake Storage (ADLS)
- Strong programming skills in Python, PySpark, Spark, SQL, Scala, Java, and Hive.
- Experience designing, developing, and maintaining scalable data pipelines.
- Knowledge of Azure Virtual Machines, Azure Storage, and Azure Networking.
- Experience with Infrastructure as Code (IaC) using ARM templates or Terraform.
- Proficiency in PowerShell, Python, or similar scripting languages.
- Understanding of DevOps practices, CI/CD pipelines, and cloud security best practices.
- Strong problem-solving, analytical thinking, and attention to detail.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Azure SQL Database, and Synapse Analytics.
- Design, implement, and manage cloud-based applications and infrastructure.
- Develop Infrastructure as Code to automate cloud resource provisioning and management.
- Create and maintain scripts for automation and deployment.
- Monitor and optimize cloud resources for performance and cost efficiency.
- Collaborate with DevOps and security teams to implement secure and scalable cloud architectures.
- Troubleshoot and resolve issues related to Azure services, data pipelines, and infrastructure.
Preferred Qualifications
- Microsoft Azure certifications, such as AZ-104 or AZ-303.
- Experience with cloud infrastructure automation and management.
- Strong communication, adaptability, and teamwork skills.
- Dice Id: PTPLpHtkHbcJfPL
- Position Id: 432936
- Posted 10 hours ago
Company Info
About Ideate Technologies LLC
Ideate Technologies is a full-service IT Organization providing Custom Software Development, Cloud Services, Technology Consulting, Business Automation, System Integration, Business Intelligence, Big Data and Data Analytic Solutions. Services we offer are built on our more than two decades of rich industry experience, technological competence and operational excellence. Our services are designed to help organizations efficiently and effectively address their business needs and challenges across multiple domains.
Constant changes in the technology landscape, cost of software development and fastest time to market are some of the challenges businesses face today, Ana-Data's services and engagement models are structured to address every one of these challenges.