MetaRPO
MetaRPO

Sr OpenShift API Developer - Big Data

Hybrid in Charlotte, NC, US • Posted 3 hours ago • Updated 3 hours ago
Contract W2
Contract Independent
24 Months
No Travel Required
Hybrid
$45 - $55/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • API
  • Access Control
  • Amazon S3
  • Amazon Web Services
  • Apache HTTP Server
  • Apache Kafka
  • Apache Spark
  • Big Data
  • Cloud Computing
  • Cloud Storage
  • Collaboration
  • Conflict Resolution
  • Continuous Delivery
  • Continuous Integration
  • Continuous Integration and Development
  • Data Processing
  • Data Storage
  • Database
  • Debugging
  • Docker
  • Encryption
  • GP
  • Git
  • GitHub
  • Grafana
  • HDFS
  • Java
  • Kubernetes
  • Management
  • Microsoft Azure
  • Orchestration
  • Problem Solving
  • PySpark
  • Python
  • RBAC
  • Regulatory Compliance
  • Resource Management
  • Scala
  • Shell Scripting
  • Sonar
  • Testing
  • Workflow

Summary

Job Description:

  • Platform Management: Deploy, configure, and maintain containerized Spark Applications on OpenShift or Google Cloud
  • Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark and Apache Airflow
    Optimization: Tune Spark jobs for performance, leveraging OpenShift's resource management capabilities(e.g., Kuberetes orchestration, auto-scaling).
    Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)
    CICD Implementation: Build and maintain CI/CD pipelines for deploying Spark application in OpenShift using tools like GitHub actions, Sonar, Harness.
  • Monitoring & Troubleshooting: Monitor cluster health, Spark job performance, and resource utilization using OpenShift tools(e.g., Prometheus, Grafana) and resolve issues proactively Security: Ensure compliance with security standards, Implementing role-based access control(RBAC) and encryption for data in transit and at rest.
  • Collaboration: Work with cross-functional teams to define requirements, Architect solutions, and support production deployments.

 

Technical Skills:

  • Proficiency in Spark frameworks(Python/PySpark, Scala, or Java)
  • Handson experience with micro services architecture solutions (eg, API design, development, and testing)
  • Proficiency in creating and maintaining conda environments and dependencies
  • Working knowledge with Docker and Kubernetes solutions (e.g., pods, deployments, services and images)
  • Knowledge of distributed systems, cloud platforms (AWS, GP, Azure), and data storage solutions (e.g., S3, HDFS)
  • Programing: Strong coding skills in Python, Scala, or Java; experience with shell scripting is a plus.
  • Tools: Experience with Git Actions, Helm, Harness, and CI/CD tools.
    Problem-Solving: Ability to debug complex issues across distributed systems and optimize resource usage.

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91175902
  • Position Id: 9076442
  • Posted 3 hours ago
Contact the job poster
NR

Narayana Rao

Recruiter @ MetaRPO
View Profile
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

OpenShift API Developer

Charlotte, North Carolina

•

2d ago

Easy Apply

Contract

Depends on Experience

Software Engineer

Charlotte, North Carolina

•

Today

Easy Apply

Contract

Depends on Experience

Python Developer - W2 Only

Charlotte, North Carolina

•

Yesterday

Easy Apply

Full-time

60 - 60

Sr. Devops Engineer (ACT/Openshift)

Hybrid in Charlotte, North Carolina

•

6d ago

Easy Apply

Contract

45 - 55

Search all similar jobs
More jobs at MetaRPO in Charlotte, NC