Senior Data Engineer (Python / AWS)

Depends on Experience

Contract: Corp-To-Corp, W2, Independent

  • No Travel Required

Skills

AWSPythonData EngineerBig dataSQLETLSparkJSONEC2S3

Job Description

Senior Data Engineer (Python / AWS)

Remote

Long term

 

For Squad lead and Data Engineer - the description and the requirements are the same as the squad can be formed with complementary skills with varying levels of experience.

 

Description:

  • A member of the Analytics squad
  • Solutions may involve design, implementation, testing, debugging, performance tuning, documentation, validation, and support.
  • Understand business drivers and processes
  • Translate business requirements into analytical solutions
  • Analyze, model and wrangle data and files to prep for utilization
  • Build data pipelines to move data into S3 and Redshift
  • Extract and provide data in multiple formats (JSON, csv, parquet, etc.)
  • Create Views in Redshift to expose data to Tableau
  • Setting up IAM Roles, Policies etc.
  • Collaborate and communicate with Senior Software Developers, Architects, Operations leads, Project managers/scrum masters etc.
  • Develop/update documentation

 

Requirements:

  • Good understanding of Cloud computing and Big data concepts (MUST have)
  • Excellent SQL skills (MUST have)
  • Equal or better knowledge of Redshift
  • Python (MUST have), SPARK and JSON
  • Good knowledge ETL & Data Warehousing concepts with hands-on experience (MUST have)
  • Good knowledge of AWS services like EC2, S3, Lambda, Glue, athena, Kinesis datastreams, Kinesis Firehose, etc.
  • Knowledge of API-based integration and security (SOAP and RestFul) - Mulesoft preferred
  • Good understanding of database concepts, modeling, knowledge of SQL. MySQL, Oracle is a plus
  • Good understanding of system and data integration from several systems
  • Setting up IAM Roles, Policies etc.
  • Strong Analytical skills
  • Ability to learn fast and translate data into actionable results
  • Excellent verbal and Written Communication skills
  • Ability to follow and document technical processes