Big Data Architect

Lambda, Jenkins, Docker, NiFi, Kafka, Spark, HBASE, Hive
Contract Independent, Contract W2, 12 Months
Depends on Experience
Work from home not available Travel not required

Job Description






CompuGain is an Information Technology and Business Consulting firm providing project-based solutions, software solutions and professional staffing services.




Job Description:


This position is a senior data architect role within Enterprise Data Delivery organization.


This critical role will provide architecture guidance and support to the eSafe platform.


A passion for data, and several years of hands-on experience leading data engineering projects, such as data architecture and data warehouse implementation projects


Experience managing large, complex projects in a high-tech development environment with multi-function teams


Strong technical background/subject matter expertise – experience as technical lead or architect on a Big Data development team


Have developed systems based on key principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms)


Strong solution delivery experience in Hortonworks or Cloudera Hadoop echo system;


Must be very familiar with Hive, Zookeeper, HBASE, Spark, HDFS, Apache Ranger etc.


Working experience of building and managing data pipelines on On-Premise and AWS Cloud data platforms using Sqoop, NiFi, Kafka, kinesis etc.


Experience in designing and implementing multi-terabyte data warehouses in MPP columnar database systems, such as Vertica, Redshift


Experience working with data streaming technologies (Kinesis, Kafka etc.)


Expertise with AWS technology stack and deployment (Docker, Jenkins, Lambda, etc.)


Prior experience in migrating on premise data platforms implementation to a cloud-based implementation




Keys to Success in this role:


Expertise with Big Data, Columnar and NoSQL database technology


Experience working in Agile/Scrum environments


Ability to work with and collaborate across the team


Experience managing large and small teams working on multiple workstreams concurrently






Education Requirements: Bachelor’s degree in computer science, information systems or another related field. 


Duration: 6 months




Thanks and Regards


Vinay Kumar | CompuGain


P: 703 520 1734


E: vinay.kumar@compugain.com



Posted By

Vinay Kumar

13241 Woodland Park Rd, Ste 610 Herndon, VA, 20171

Dice Id : RTL61687
Position Id : 19-00902
Have a Job? Post it