Big Data Engineer - Java, Spark, Kafka, AWS

Data Warehousing, BigDAta, Mongo DB, Cassandra, NoSQL, SQL, Spark, Kafka, Python, Java, Scala, Shel, AWS, Big data, S3, Redshift, EMR, Elastic search, Qubole
Contract Independent, Contract W2, 12 Months
Depends on Experience
Work from home not available Travel not required

Job Description

Hi,
We are looking for creative, energetic, and passionate engineers to join our technology team. We are a team of engineers building a cutting-edge Data Pipelines and platforms on data to provide real-time intelligent insights to our internal and external partners via a varied set of tools and services. This initiative will be the foundation to several key investments. The landscape is complex and the solution demands a scalable and flexible real-time data solution, utilizing state of the art big data cloud platforms and technologies.

Responsibilities:

* Build powerful, scalable, and reliable big data products using SQL and non-SQL technologies, and web services with real-time streaming and data processing capabilities in the cloud (AWS)

* Contribute to the end-to-end product life cycle: Designing, development, testing, deployment, and providing operational excellence and support

* Prototype creative solutions to enable product MVPs

* Innovate and implement new ideas to solve complex software problems

* Find and advocate for industry standards and best practices in development methodologies, techniques, and technologies

* Contribute to advancing the team's design methodology and quality programming practices

* Effectively coordinate, and collaborate on multiple concurrent and complex cross-organizational initiatives involving high volumes of data and high levels of stability & latency requirements

* Work cross-functionally to resolve technical, procedural, and operational issues and proactively identify and prevent problems

* Provide timely and appropriate updates on the project, and issue status to business owners, stakeholders, leadership, and peers

* Work effectively with remote leadership and collaborate with global teams

Qualifications:

* 3+ years experience building, delivering, and supporting big data tools, services, and products

* 2+ years experience working with cloud infrastructure and AWS Big Data/Data Warehousing technologies

* Development skills in relevant Big Data technologies, including but not limited to SQL and non-SQL data stores like Mongo DB or Cassandra

* Experience working with Hadoop, Hive, Teradata, Redshift and similar DB Technologies

* Real-time data streaming and processing technologies like Spark and Kafka

* Background in Data Warehousing principles, architecture, and its implementation in large multi-terabyte environments

* Proficient in one of the programming languages like Python/Java/Scala/Shell and Unix/Linux environments

* Experience working in AWS environment and AWS Big data technologies like S3, Redshift, EMR, Elastic search and similar technologies like Qubole

* Knowledge and proven experience in Object Oriented design, SOA, distributed computing, performance/scalability tuning, advanced data structures and algorithms, real time analytics and large scale data processing

* Previous experience working experience in Agile development process

* Experience and proven success as a software engineer with a track record of on-time delivery of large enterprise level projects

Please feel free to call email me, in case of any questions. Thanks, Raju - 510 585 1527 /

Best Regards,

Raju

Posted By

Nagaraju Gollapalli

4637 Chabot Dr. Suite 250 Pleasanton, CA, 94588

Contact
Dice Id : 10494547
Position Id : 6001993
Have a Job? Post it

Similar Positions

Senior Data Engineer
  • G.1440, LLC
  • Chicago, IL
Big Data Developer
  • Net2Source Inc.
  • Chicago, IL
Senior Developer (Spark & Cloudera )
  • ITC Infotech
  • Lincolnshire, IL
Big Data engineer
  • Synergy Computer Solutions
  • Mettawa, IL
Senior Big Data Engineer
  • Appcast
  • Northbrook, IL
Hadoop Developer
  • Neorithm technologies Inc
  • Chicago, IL
BigData Developer
  • Creospan
  • Chicago, IL
Sr Big data Engineer with AWS
  • TESTINGXPERTS, INC. DBA DAMCOSOFT
  • Chicago, IL
Big Data / Hadoop developer
  • HR Pundits
  • Chicago, IL
GCP Data Engineer-BigQuery and Dataflow
  • Virtusa
  • Chicago, Illinois
Big Data Python Spark Developer
  • Computer Data Concepts
  • Chicago, IL