Overview
Remote
$60 - $65
Contract - W2
Contract - 12 Month(s)
Skills
GCP
Spark
Pyspark
Retail
Sql
Python
Job Details
Position: Senior Data Engineer (12-16 years) Location: Bentonville, AR (Remote)
Requirement:
Candidates should have strong experience in handling live production issues and be able to troubleshoot and resolve problems in real-time.
Mandatory Skills:
- Scala
- Google Cloud Platform
- Spark
- Cloud Services
- Retail Domain
- Airflow
- SQL
- PySpark
- CI/CD
Key Responsibilities:
- Develop application in Google Cloud Platform/Python/SQL Design, implement, and troubleshoot CI/CD pipelines using Google Cloud Platform and Astronomer-managed Airflow.
- Set up and maintain Google Cloud Platform infrastructure including storage, roles, and permissions.
- Deploy and manage Airflow environments (prod/non-prod), handle version upgrades, and assist users in DAG setup and scheduling.
- Monitor and respond to alerts (xMatters/Slack), provide on-call support, and manage user tickets and queries.
- Plan and execute data migrations, resolving performance and configuration issues.
- Optimize cloud storage, implement data lifecycle policies, and manage storage costs and performance.
- Administer containerized workloads using Kubernetes, Docker, and Helm Charts. Required Skills
- Strong background in Linux/UNIX systems administration and command-line tools.
- Proficiency in Python and bash scripting
- Hands-on experience with cloud platforms (AWS, Azure, Google Cloud, or others).
- Strong experience in DevOps or Site Reliability Engineering roles.
- Strong hands-on experience with Google Cloud Platform (Dataproc, IAM, Storage).
- Experience managing container-based infrastructures, including Docker and Kubernetes.
- In-depth knowledge of CI/CD tools and practices.
- Deep understanding of DevOps principles, infrastructure as code, and cloud security best practices.
- Monitoring and Logging tools : Prometheus, Grafana, Splunk etc
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.