BigData Architect

Bigdata, Spark, Hadoop, AWS EMR, Athena, Data Pipeline, PySpark, Java
Contract W2, Contract Independent, Contract Corp-To-Corp
Depends on Experience
Travel not required

Job Description

About GSPANN

We work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create custom-designed technology platforms, which have transformed the way our clients connect with their employees, partners, and customers. GSPANN is headquartered in Milpitas, CA with satellite offices around the world.

To know more about GSPANN, visit our website www.gspann.com

Or connect on social media platforms: LinkedIn, Twitter and Facebook.

BigData Architect
Location-Portland, OR
Job Type-Long Term

Skills: Bigdata, Spark, Hadoop, AWS EMR, Athena, Data Pipeline, PySpark, Java with OO programming skills

Must have

  • Working experience and communicating with business stakeholders and architects
  • Industry experience in developing relevant big data/ETL data warehouse experience building cloud native data pipelines 
  • Experience in Python, Pyspark, Scala, Java and SQL Strong Object and Functional programming experience in Python
  • Experience worked with REST and SOAP based APIs to extract data for data pipelines
  • Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, Sqoop, etc.
  • Experience working in a public cloud environment, particularly AWS is mandatory
  • Ability to implement solutions with AWS Virtual Private Cloud, EC2, AWS Data Pipeline, AWS Cloud Formation, Auto Scaling, AWS Simple Storage Service, EMR and other AWS products, HIVE, Athena
  • Experience in working with Real time data streams and Kafka Platform.
  • Working knowledge with workflow orchestration tools like Apache Airflow design and deploy dags.
  • Hands on experience with performance and scalability tuning
  • Professional experience in Agile/Scrum application development using JIRA

Working at GSPANN

GSPANN is a diverse, prosperous, and rewarding place to work. We provide competitive benefits, educational assistance, and career growth opportunities to our employees. Every employee is valued for their talent and contribution. Working with us will give you an opportunity to work globally with some of the best brands in the industry.

The company does and will take an affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans, and to treat qualified individuals without discrimination based on their physical or mental disability status. GSPANN is an equal opportunity employer for minorities/females/veterans/disability.

Dice Id : 10200091
Position Id : 6743603
Originally Posted : 3 months ago
Have a Job? Post it