Overview
Remote
$60 - $65
Contract - Independent
Contract - W2
Contract - 12 month(s)
No Travel Required
Skills
Cribl
Vectro
ADF
ETL
API
Job Details
Position: Data Engineer
Job Description:
Mandatory Skills: Vector and Cribl
8+ years of experience.
Job Description:
Mandatory Skills: Vector and Cribl
8+ years of experience.
- Design and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).
- Build and manage API integrations for data exchange between systems.
- Write and optimize SQL queries and stored procedures for data transformation and analysis.
- Implement Azure cloud services, including Azure Data Lake, Azure SQL Database
- Develop Python-based data processing solutions for automation and orchestration.
- Monitor, troubleshoot, and optimize data workflows and pipelines.
- Ensure data security, governance, and compliance with industry standards.
- Undertake Unit testing making full utilization of automation tools available and working with the system test team to ensure tests are integrated as
- part of the overall test plan.
- Good multi-tasking and flexibility to stretch when situation demands.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.