Azure Data Engineer

Job Title: Azure Data Engineer

Location: Richmond, VA

Duration: 6+ Months

Job Description:

Responsibilities:

• Design, develop, and maintain scalable data pipelines and architectures on Azure Cloud.
• Implement and manage Azure Data Lake solutions to store and process large volumes of data.
• Utilize Databricks for data processing, transformation, and analytics.
• Develop and maintain ETL processes using Azure Data Factory.
• Write efficient and optimized SQL queries to extract, transform, and load data.
• Work with relational databases to ensure data integrity and performance.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Implement data security and compliance measures in accordance with industry standards.

Qualifications:

• A Bachelor's degree in Computer Science, Information Technology, or a related field is required.
• 10+ years of Data Engineering experience with a focus on Azure Cloud services for 3+ years.
• 5+ years of experience working with Azure Data Lake.
• 5+ years of Python for data processing and automation.
• 5+ years of Databricks experience.
• 5+ years of Azure Data Factory (ADF) for extra, transfer, load process.
• 5+ years of SQL and prior experience with other ETL processes such as SSIS.
• Familiarity with data governance and security is the best practice.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities.

Preferred Qualifications:

• Master's degree in a related field.
• Certification in Azure Data Engineering or related Azure certifications.
• Experience with other Azure services such as Azure Synapse Analytics, Azure Machine Learning, etc.
• Knowledge of big data technologies like Hadoop, Spark, etc.

With Regards,

Dinesh B

CS Solutions, Inc

7525 Mitchell Road, Suite 106, Eden Prairie, MN 55344

Email ID -

Direct Number