Big Data Architect Spark "Hands On"

Spark, Architect, Big Data, AWS, Amazon Web Services, Hive
Full Time
175000
Telecommuting not available Travel not required

Job Description

Big Data Architect Spark "Hands On"

Location: Rosemont, IL.

Full time permanent role

Salary is commensurate with experience

Company will Not provide sponsorship for position.

Company will Not provide relocation moving expenses for position.

 

Key Points: If interested, next to each point put number of years.

 

  • Experience in architecting Big Data solutions in Amazon Web Services

  • Must have Hive-on-Spark and hands on architecture

  • AWS (EMR, S3, Data Pipelines, Kinesis Firehose and Java SDK)

Summary: Seeking an architect with hands-on experience, willing to share their knowledge by mentoring and coaching a young big data team. A successful candidate must be a self-starter, fast learner and able to be part of a cross-functional, SCRUM software development team. This person is a strong technology professional and Big Data architect with significant experience with Big Data technologies. The position will include working with a global team, as well as external vendors to implement the components of the new architecture and maintain the existing.

 

Essential Job Functions:

  • Audit existing architecture, recommend, define and document best practices

  • Architecting next generation Big Data platform using Apache Hadoop

  • In collaboration with the Technical Lead, research, evaluate and recommend technologies

  • In collaboration with the Database Architect, develop and maintain data models

  • Mentor team while delivering architecture and features in an agile methodology

Qualifications:

  • Experience in architecting Big Data solutions in Amazon Web Services

  • Expert knowledge of Big Data and data warehouse concepts

  • Expert knowledge of Big Data ETL technologies (ex.: Spark, Hive)

  • Good oral and written communication skills

  • English / French (nice-to-have)

Preferred skills

  • Apache Hadoop, YARN, Hive, Spark, Oozie and Sqoop

  • Hive-on-Spark

  • Storage: JSON, Avro, Parquet

  • AWS (EMR, S3, Data Pipelines, Kinesis Firehose and Java SDK)

  • Java 8 and Maven (if you know what a lambda function is we already like you!)

  • Unit testing framework for Java, Hive and other related technologies

  • Jenkins

  • Experience with Atlassian tools (Bitbucket, Jira, Confluence)

Posted By

Jeanette Cotledge

IL

Dice Id : 10128864
Position Id : DSparksjc
Have a Job? Post it