AWS Data Engineer (Glue & PySpark)

New York, NY, US • Posted 21 hours ago • Updated 21 hours ago
Contract Corp To Corp
Contract Independent
75% Travel Required
On-site
60+
Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

  • Access Control
  • Amazon Lambda
  • Amazon S3
  • Amazon Web Services
  • Apache Spark
  • Cloud Computing
  • Data Flow
  • Data Integration
  • Data Processing
  • Extract, Transform, Load
  • Extraction
  • JON
  • Management
  • Orchestration
  • PySpark
  • Python
  • Scripting
  • Terraform
  • Workflow

Summary

We are seeking a python AWS Glue developer responsible for designing, developing, and maintaining scalable data pipelines using AWS Glue and Python. The role involves working closely with data engineers, architects, and business stakeholders to ensure data integration, transformation and loading processes within the cloud environment. Design, develop and maintain scalable ETL pipelines using AWS glue and python, write PySpark scripts for extraction, transformation and loading, configure glue jobs, crawlers and workflows for automated data processing.Cloud Data Engineeing: Work with AWS S3 for data stoareg and management. Use AWS IAM for access control and security, Leverage AWS Lambda for serverless orchestration and event driven processing.Monitor Glue jon metrics, using AWS cloudwatch, Tune Spark configurations for Optimal performance.Document ETL processses, data flows, and technical decisionsExperience with infrastructure as code (Terraform, CloudFormartion)

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099306
  • Position Id: 8949305
  • Posted 21 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Jersey City, New Jersey

Today

Easy Apply

Third Party, Contract

Depends on Experience

Hybrid in New York, New York

13d ago

Easy Apply

Third Party, Contract

Depends on Experience

Jersey City, New Jersey

20d ago

Easy Apply

Contract

Depends on Experience

Jersey City, New Jersey

Yesterday

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs