Cloud Big Data Engineer

Big Data infrastructure, Cloud and Big Data technologies, S3, Redshift, Aurora, Kinesis, Kafka, EMR, Lambda, SNS, Azure Blob Storage Account, Jenkins, sonar cube
Contract W2, Contract Corp-To-Corp
$120,000 - $140,000
Travel not required

Job Description

  • Designing, Architecting, and Developing solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements
  • A bachelor's degree and approximately six years of related work experience; or a master's degree and approximately five years of related work experience
  • At least five years hands-on experience with various Cloud and Big Data technologies
  • At least three years hands on experience in implementing, automating and integrating Big Data infrastructure resources like S3, Redshift, Aurora, Kinesis, Kafka, EMR, Lambda, SNS, Azure Blob Storage Account ,SQL Data Warehouse, Microsoft Event Hubs , HDInsights, Azure Databricks, Azure Functions,Event Grid, Data Lake Analytics in an ephemeral/transient and in an elastic manner
  • IaC & Config Management: Tools like Chef, puppet, CloudFormation ,terraform, ansible, boto3 and/or Azure/Google Cloud Platform equivalent
  • Hands on experience of core Operating systems like Linux RHEL, Ubuntu, System administration tasks including shell scripting
  • Network Engineering/Admin (vpc, subnet, security groups, VPC-Endpoints, nat/route tables, etc)
  • Experience with container technology like docker, kubernetes etc.
  • Security tools/concepts like At Rest and in transit Encryption, IAM, key and certificate management etc.
  • CI/CD pipeline management like git/bitbucket, and code deployment tools like Jenkins, sonar cube
  • Communication is essential, must be able to listen and understand the question and develop and deliver clear insights.
  • Outstanding team player.
  • Independent and able to manage and prioritize workload.
  • Ability to quickly and positively adapt to change.
  • A valid driver’s license in the US; willingness and ability to travel to meet client needs.
Dice Id : 91118679
Position Id : 6686596
Originally Posted : 3 months ago
Have a Job? Post it

Similar Positions

Python Software Engineer II (Backend)
  • American Cybersystems, Inc.
  • Sunnyvale, CA
Python Developer
  • Mainz Brady Group
  • San Jose, CA