Big Data Engineer

Python, Architecture, Apache, IT, Management, Application, Security, Programming, Java, SQL, Shell Scripting, MySQL, Manager, Web, Software, SAS, Unix, Linux
Full Time

Job Description

Design and Develop Data Ingestion and Processing Code using Python/Pyspark/ Language R/Hive on the Cloudera CDH Platform.

Create and update Design Specs and reference Architecture documents to enable acceleration in solution development.

Cloudera Data Platform Innovating new ideas, researching related technology, developing new concepts, prototyping and delivering implementations

Participate in testing and peer code reviews to identify any bugs and ensure reusability of code.

Automate the deployment of the solutions by using Shell scripts/Python/Oozie.

Work with internal subject matter experts to define requirements for new demo environments

Collaborating with the Apache community on Hadoop and other related open source projects

Work with IT change Management group to promote the developed code/scripts from non-production to production environments.

Work with Architecture team (Application/Security/Infrastructure/Data) to get their approval on the designed solutions.

Tools and Technology Experience that candidates should have..

Programming Languages - Python, PySpark, Java, SQL, Shell Scripting, Sqoop

Big Data Tools - Spark, HDFS, Kafka, Hive, HBase

Databases - MySQL, PostgreSQL , SQL Server, SnowFlake

Cloudera Technologies - Cloudera Data Platform & Cloudera Manager

Cloud Technologies - Amazon Web Services, AWS Big Data Platform.

OpenStack Other Software & Tools - Tableau, SAS, Docker, Kubernetes, GitHub

Unix/Linux expertise
Dice Id : 10430981
Position Id : 38106
Originally Posted : 5 months ago
Have a Job? Post it

Similar Positions

Senior OR Lead Java Developer (Big-Data experience required)
  • DISYS - Digital Intelligence Systems, LLC
  • Reston, VA, USA
Big Data Developer
  • National Computer Systems
  • Reston, VA, USA
Big Data Developer (Java)
  • Polaris IT Solutions Inc
  • Washington, D.C., DC, USA
Senior Big Data Engineer
  • GEICO
  • Chevy Chase, MD, USA
Big Data Apps Developer
  • Guardian Info Group
  • Dulles, VA, USA
Sr Hadoop Developer with JAVA
  • ALTA IT Services
  • Reston, VA, USA
Hadoop Cloudera Administration
  • Lumen Solutions Inc
  • Washington, D.C., DC, USA
Cloudera Stack Engineer
  • Leidos
  • Reston, VA, USA
Cloudera Stack Engineer
  • Leidos
  • Bethesda, MD, USA