Overview
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - Contract
Skills
scripting
git
continuous integration
CLOUD COMPUTING
MICROSOFT AZURE
BANKING SERVICES
SENSORS
DATA WAREHOUSING
AMAZON WEB SERVICES
SQL DATABASES
Data Pipelines
Apache Kafka
Python (Programming Language)
Software Version Control
Scrum Methodology
Data Lakes
Apache Nifi
Airflow
Directed Acyclic Graph (Directed Graphs)
Job Details
Job Title: Data Engineer
Job Location: Remote
Job Type: Contract
Job Description:
- Strong hands on experience with Apache Airflow and Python
- Proficient in Python scripting for Airflow DAGs
- Experience with Airflow plugins custom operators and sensors
- Knowledge of data pipeline orchestration best practices
- Experience with Apache NiFi nice to have
- Familiarity with Cloud platforms AWS Google Cloud Platform Azure and on premises environments
- Understanding of CICD pipelines and version control eg Git is a plus
- Exposure in Apache Kafka brokers topics partitions replication preferred
- Experience with Kafka Connect Schema Registry and Kafka Streams preferred
- Exposure to Data Warehousing concepts and SQL
- Experience with Data Lakes preferred
- Agile Scrum experience in live projects
- Ability to develop execute tests analyse data identify defects and fix issue
- Exposure to Banking domain especially Treasury is a plus
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.