Big Data Engineer

Scala, Java, Python, Oracle, HBase, Hive
Contract W2, Contract Independent, Contract Corp-To-Corp
Depends On Experience
Work from home not available Travel not required

Job Description

Title: Big Data Engineer

Location: Sunnyvale, CA

Duration: 6 Months

Job Description

Job Responsibilities:

  • Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
  • Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases.
  • Perform offline analysis of large data sets using components from the Hadoop ecosystem.
  • Evaluate and advise on technical aspects of open work requests in the product backlog with the project lead.
  • Own product features from the development phase through to production deployment.
  • Evaluate big data technologies and prototype solutions to improve our data processing architecture.


Candidate Profile:

  • BS in Computer Science or related area
  • Around 6 years software development experience
  • Minimum 2 Year Experience on Big Data Platform
  • Must have active current experience with Scala, Java, Python, Oracle, HBase, Hive
  • Flair for data, schema, data model, how to bring efficiency in big data related life cycle
  • Understanding of automated QA needs related to Big data
  • Understanding of various Visualization platform
  • Experience in Cloud providers like AWS preferable
  • Proficiency with agile or lean development practices
  • Strong object-oriented design and analysis skills
  • Excellent written and verbal communication skills



Top skill sets / technologies in the ideal candidate: * Programming language -- Java (must), Python, Scala

* Database/Search – Oracle, complex SQL queries, stored procedures, performance tuning concepts, SOLR, AWS RDS,  AWS Aurora

* Batch processing -- Hadoop MapReduce, Cascading/Scalding, Apache Spark, AWS EMR * Stream processing -- Spark streaming, Kafka, Apache Storm, Flink * NoSQL -- HBase, Cassandra, MongoDB * ETL/ELT Frameworks including monitoring, alerting, restart * Code/Build/Deployment -- git, svn, maven, sbt, Jenkins, bamboo: PERSONAL QUALIFICATIONS * Excellent communication and decision making skills are essential. * Strong analytical, problem solving and decision-making skills.

* Zeal to lean new technologies, frameworks and appetite for growth * Identify project risks and recommend mitigation efforts. * Identify project issues, communicate them and assist in their resolution. * Assist in continuous improvement efforts in enhancing project team methodology and performance. * Cooperative team focused attitude

Posted By

Anil Kumar

Dice Id : sdksoft
Position Id : 785686
Have a Job? Post it

Similar Positions

Big Data Engineer
  • Xoriant Corporation
  • Santa Clara, CA
Big Data Engineer _ 4 openings
  • BayOne Solutions
  • San Jose, CA
Big Data Engineer
  • Akshaya Inc
  • Milpitas, CA
Sr Big Data Architect HADOOP
  • GSPANN Technologies
  • Milpitas, CA
Senior Big Data Hadoop
  • Profile500 Corporation
  • Santa Clara, CA
Big Data Lead
  • Infotree Service Inc.
  • Santa Clara, CA
BigData Engineer - Hadoop Kafka
  • Flexton Inc
  • Sunnyvale, CA
Big Data Developer - P CA
  • Saama Technologies, Inc.
  • Dublin, CA
Big Data Developer
  • Terranova Consulting
  • Pleasanton, CA
Big data architect or bigdata lead
  • Talented IT
  • San Jose, CA
Hadoop Developer
  • Agile HealthTech Inc.
  • Sunnyvale, CA
Big Data Hadoop Opportunity for Sunnyvale, CA
  • Infobahn Softworld Inc.
  • Sunnyvale, CA