Overview
Skills
Job Details
Python/Cloud Full stack engineer
Start/End Dates: 4/27/2025 - 4/26/2026
Work Location: USA-NC-CHARLOTTE-300 S Brevard St-142019
Job Description and Requirements -
Python/Cloud Full stack engineer.
Seeking a full stack Engineer to join our team, with expertise in Cloud, Python/Spark and OpenShift. This role focuses on designing, deploying and managing scalable data processing solutions in a cloud-native environment. You will work closely with data scientists, software engineers, and DevOps team to ensure robust, high-performance data pipelines and analytics platforms.
Responsibilities:
- Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark
- Container Development: Design and implement docker images
- Optimization: Tune Spark jobs for performance, leveraging OpenShift's/Cloud resource management capabilities
- Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes)
Qualifications:
- Experience:
o 3+ years working on Apache Spark for big data processing.
o 1+ years of Django and Airflow development experience.
o 1+ years of Cloud development experience. (Google Cloud preferred)
Technical Skills:
- Proficiency in Spark frameworks(Python/PySpark)
- Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images)
- Hands on working experience on distributed systems, cloud platforms(AWS, Google Cloud Platform, Azure), and data storage solutions (e.g., S3, HDFS)
- Programing: Strong coding skills in Python, Airflow, Django; experience with shell scripting is a plus.
- Education: Bachelor's degree in Computer Science, Engineering or related filed.