Big Data Engineer with AWS

AWS, S3/Redshift, Parquet, EC2, EMR, HP Vertica, SQL, Teradata, Scala, PySpark, ETL
Full Time
Depends On Experience
Work from home not available Travel required to 10%.

Job Description






One of our clients who is a leading cloud analytics company that has pioneered analytical applications for consumer facing businesses is actively hiring Big Data Engineer with experience of AWS in Philadelphia, PA.




Position: Big Data Engineer with AWS


Location: Philadelphia, PA


Duration: Full-Time/Permanent


Experience Level: 4-8 Years




Job Description:



  • Building data pipelines, writing ETL logic in PySpark, or Scala.

  • Ingestion of data into AWS from trafficking systems, on-premise databases (Teradata, MS SQL Server, HP Vertica etc.), on-premise Hadoop cluster etc.

  • Spinning up appropriate EMR, EC2 instances for the job

  • Scheduling the jobs and automating the jobs

  • Creating the data sets in the appropriate format, i.e. Parquet

  • Ingesting the data into S3/Redshift or any data ware house for external team to consume into their application




To discuss about an opportunity in detail, please connect with Raja Vishwakarma at 847-201-6969 or email him at raja.v@apideltech.com.




Dice Id : 10509960
Position Id : 337_K2
Have a Job? Post it