Overview
Remote
$50 - $60
Full Time
No Travel Required
Skills
AWS
ETL
Python
AWS Managed FlinkAWS
Job Details
Our client in Rochester, NY, is looking to hire a remote Data Processing Engineer.
This is a fully-remote/part-time/3-month contract position (No Third Party Employers please)
Hourly range based on experience: $50-$60/HR
Primary Responsibilities:
- Implement AWS SNS topic as Google Cloud Platform PubSub equivalent
- Convert Apache Beam configurations to AWS Managed Flink for ~16 jobs
- Integrate AWS Managed Flink with AWS Glue
- Configure Glue Data Catalog for processed data storage
- Set up and configure AWS Managed Airflow
- Migrate workflows from Google Composer to AWS MWAA
- Assist with testing and documentation of data processing components
- Support AWS Marketplace integration for data processing aspects
Required AWS Service Skills:
- AWS Managed Flink
- AWS SNS
- AWS Glu
- AWS MWAA (Managed Airflow)
- AWS Lambda
- Amazon CloudWatch
- AWS IAM
Required Technical Skills:
- Python (advanced)
- Terraform
- Apache Beam
- Apache Airflow
- ETL Pipeline Development
- Data Processing
- Streaming Data Architecture
Required Soft Skills:
- Problem-solving
- Team Collaboration
- Technical Documentation
- Communication Adaptability
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.