Overview
Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
Big Data
Amazon RDS
Amazon Kinesis
Amazon Redshift
API
Apache Hadoop
Apache Spark
Amazon SQS
Amazon Web Services
Python
Extract
Transform
Load
Amazon S3
Step-Functions
Streaming
Terraform
Storage
SQL
Git
Java
Kubernetes
PostgreSQL
Use Cases
Apache Flink
Apache HTTP Server
Cloud Computing
Apache Kafka
Microservices
Remote Desktop Services
Job Details
REQUIREMENT:
Job ID & Position: 44312-1- Big Data Architect
Location: Charlotte, NC - Hybrid (2 days onsite in a week)
Duration: Longterm Contract
Job Description:
Must have experience with similar platform engineering/management solutions:
* Building/optimizing Data LakeHouse with Open Table formats
* Kubernetes deployments/cluster administration
* Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS
* Distributed Systems, Microservice architecture, and containers
* Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis)
Must have hands-on experience with below tech stack:
* Git Hib and Git Hub Actions
* AWS IAM, API Gateway, Lambda, Step Functions, Lake Formation, Glue (Catalog, ETL, Crawler), Athena, S3 (Strong foundational concepts like object
data store vs block data store, encryption/decryption, storage tiers etc)
* Python
* EKS & Kubernetes, Apache Hudi, Flink, PostgreSQL and SQL, RDS
* Java background
* Terraform Enterprise
Helpful tech stack experience would include:
* Helm, Kafka and Kafka Schema Registry, AWS Services: CloudTrail, SNS, SQS, CloudWatch, Aurora, EMR, Redshift, Iceberg, Vault, AWS Secrets manager
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.