Overview
Skills
Job Details
Skill | Required / Desired |
Hands on solution development on AWS cloud using Data Engineering Services and integrating with various internal and external applications. | Required |
Expertise in designing, developing, and maintaining APIs specifically tailored for cloud environments (e.g., AWS API Gateway). | Required |
Experience with Power BI, Snowflake and AWS data Lake integrations or similar | Required |
Automate the provisioning and management of cloud infrastructure using tools like AWS CloudFormation | Required |
Strong understanding of DevOps practices, including developing and optimizing CI/CD pipelines, version control, and collaboration tools | Required |
Data Ingestion and Transformation using Amazon S3, AWS Glue, Amazon EMR, AWS DMS, Amazon Redshift, AWS Lambda, Amazon AppFlow | Required |
Setting up schedulers by using Amazon EventBridge, Apache Airflow, or time-based schedules for jobs and crawlers DynamoDB, Kenesis, RDS etc. | Required |
Implementing data transformation services based on requirements using AWS Glue, Lambda etc. | Required |
Using orchestration services to build workflows for data ETL pipelines (for example, Lambda, EventBridge, Amazon Managed Workflows for ApacheAirflow ) | Required |
AWS Cloud Solution Architect and Data Engineer Certifications | Highly desired |
AWS Data Zone Experience | Highly desired |