Overview
Hybrid2-3 Days Onsite/Week
$50 - $70
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 6 Month(s)
75% Travel
Skills
Data Storage
Apache Spark
Big Data
Cloud Computing
Cloud Storage
Data Processing
Database
Google Cloud
Google Cloud Platform
HDFS
Kubernetes
DevOps
Django
Docker
Extract
Transform
Load
GC
Resource Management
Good Clinical Practice
Management
Microsoft Azure
PySpark
Python
Amazon S3
Amazon Web Services
Analytics
Apache HTTP Server
Apache Kafka
Shell Scripting
Workflow
Job Details
Job Description -
Job Description -
Python/Cloud Full Stack Engineer
Location: Charlotte, NC (Hybrid)(Must be local) Seniority Level: Senior Engineer
Must be on PV W2
client is wells fargo
EAD
must have 8+ years of experience
Seeking a full stack Engineer to join our team, with expertise in Cloud, Python/Spark and OpenShift. This role focuses on designing, deploying and managing scalable data processing solutions in a cloud-native environment. You will work closely with data scientists, software engineers, and DevOps team to ensure robust, high-performance data pipelines and analytics platforms.
Responsibilities:
- Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark
- Container Development: Design and implement docker images
- Optimization: Tune Spark jobs for performance, leveraging OpenShift s/Cloud resource management capabilities
- Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)
Qualifications:
- 3+ years working on Apache Spark for big data processing.
- 1+ years of Django and Airflow development experience.
- 1+ years of Cloud development experience. (Google Cloud preferred)
Technical Skills:
- Proficiency in Spark frameworks(Python/PySpark)
- Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)
- Hands on working experience on distributed systems, cloud platforms(AWS, Google Cloud Platform, Azure), and data storage solutions (e.g., S3, HDFS)
- Programing: Strong coding skills in Python, Airflow, Django; experience with shell scripting is a plus.
- Education: Bachelor s degree in Computer Science, Engineering or related filed.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.