AWS Cloud and ETL developer

  • Jersey City, NJ
  • Posted 4 days ago | Updated 2 days ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2

Skills

AWS
ETL
Apache
Casandra
Amazon
Spark

Job Details

Role: AWS Cloud and ETL developer

Location: Houston, TX/ Jersey City, NJ (Need Locals only)

Mail:

Please don t share Fake consultants

Technical Skills:

  • ETL Tools: Talend (Nice to have)
  • Database: Snowflake, Oracle, Amazon RDS (Aurora, Postgres), DB2, SQL server and Casandra,
  • Big Data and Amazon Services: Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker, Apache Spark
  • Data Modeling Tools: Archimate (not mandated- secondary/preferred), Erwin, Oracle Data Modeler (secondary/preferred)
  • Scheduling Tools: Autosys, SFTP, AirFlow (preferred. This should not be an issue, any resource can learn how to use it)

Note: (Yellow highlighted skills are mandatory) Non highlighted, even if they don t have, they should learn once after onboarded

Key Responsibilities:

  • Designing, building, and automating ETL processes using AWS services like Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker Apache Spark.
  • Developing and maintaining data pipelines to move and transform data from diverse sources into data warehouses or data lakes.
  • Ensuring data quality and integrity through validation, cleansing, and monitoring ETL processes.
  • Optimizing ETL workflows for performance, scalability, and cost efficiency within the AWS environment.
  • Troubleshooting and resolving issues related to data processing and ETL workflows.
  • Implementing and maintaining security measures and compliance standards for data pipelines and infrastructure.
  • Documenting ETL processes, data mappings, and system architecture.
  • Implementing security measures such as IAM roles and access controls.
  • Diagnosing and resolving issues related to AWS services, infrastructure, and applications.
  • Proficiency in Big data tool and AWS services: Including Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker, Apache Spark relevant to data storage and processing.
  • Strong SQL skills: For querying databases and manipulating data during the transformation process.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.