Overview
On Site
BASED ON EXPERIENCE
Contract - Independent
Contract - W2
Contract - 8+ mo(s)
Skills
IaaS
Streaming
Root Cause Analysis
Orchestration
Collaboration
Onboarding
Workflow
Incident Management
Cloud Computing
Software Engineering
Kubernetes
Amazon EKS
Python
Data Processing
Apache Airflow
Performance Tuning
Amazon EC2
Amazon S3
Virtual Private Cloud
Terraform
Docker
Continuous Integration
Continuous Delivery
Communication
Amazon Web Services
DevOps
Unix
Linux
Shell Scripting
SANS
Apache Spark
Apache Flink
Databricks
FOCUS
Professional Services
Genetics
Law
Job Details
Senior Cloud Infrastructure Engineer (Data Platforms) - Long Term Project - San Francisco, CA
The Ad Infrastructure team is looking for a seasoned Software and Cloud Infrastructure Engineer to help build and scale our data processing platforms. This role is focused on enabling infrastructure and DevOps capabilities for high-scale batch and streaming workloads, including Spark and Flink on EKS. Our mission is to reduce the cognitive load on application and data teams by delivering scalable, secure, and easy-to-operate infrastructure and tools that accelerate development and delivery.
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
Title: Senior Cloud Infrastructure Engineer (Data Platforms)
Location: San Francisco, CA
Duration: Long Term Project - 6+ Months
Compensation: $80-100/hr
Work Requirements: , Holders or Authorized to Work in the U.S.
The Ad Infrastructure team is looking for a seasoned Software and Cloud Infrastructure Engineer to help build and scale our data processing platforms. This role is focused on enabling infrastructure and DevOps capabilities for high-scale batch and streaming workloads, including Spark and Flink on EKS. Our mission is to reduce the cognitive load on application and data teams by delivering scalable, secure, and easy-to-operate infrastructure and tools that accelerate development and delivery.
What You'll Do
- Design, build, and maintain infrastructure automation and tooling that enables developers to deploy and operate cloud-native applications.
- Implement best practices for secure, scalable, and cost-efficient cloud operations across AWS.
- Contribute to and maintain a robust library of shared Terraform modules and infrastructure-as-code standards.
- Participate in root cause analyses (RCAs) and postmortems to continuously improve reliability and operational practices.
- Support container orchestration and workload scaling on Kubernetes (EKS) for Spark and Flink jobs.
- Collaborate with development teams to ensure seamless onboarding and operational support for infrastructure tooling and platforms.
- Participate in on-call rotations and own uptime and reliability of key systems.
- Drive adoption of DevOps practices, including CI/CD workflows, observability, and incident management.
- 7+ years of experience in infrastructure engineering, DevOps, or cloud-native softwareengineering.
- 4+ years of hands-on experience with Kubernetes, preferably on Amazon EKS.
- 3+ years of experience with Python or Go for infrastructure automation.
- 3+ years working with data processing frameworks such as Apache Airflow, Spark, or Flink.
- 2+ years designing and operating Databricks environments at scale on AWS, including performance tuning and securing workloads.
- Expertise in AWS services (EC2, S3, IAM, VPC, etc.), infrastructure automation, and Terraform.
- Experience with container technologies (Docker) and CI/CD tools like Spinnaker.
- Strong communication skills and a collaborative mindset for working across engineering teams.
- AWS Certifications (e.g., Solutions Architect, DevOps Engineer).
- Experience with Unix/Linux systems and shell scripting.
- Familiarity with all three: Airflow, Spark, and Flink.
- Experience operating service mesh technologies like Istio.
- Experience running Spark or Flink workloads on Databricks.
- Comprehensive medical benefits
- Competitive pay
- 401(k) retirement plan
- and much more!
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.