Senior Cloud Engineer

Job Description

The Cloud Operations and Data Quality Engineer is responsible for the deployment, monitoring, maintenance, and optimization of cloud infrastructure supporting Quest Diagnostics' Health Analytics Solutions (HAS) data platforms and analytics applications. This role ensures high availability, performance, and security of cloud-based systems while implementing best practices for infrastructure as code, automation, and operational excellence. The Cloud Operations Engineer works closely with data engineering, analytics, and development teams to support production workloads, troubleshoot issues, and implement scalable solutions that meet business and compliance requirements. This position plays a critical role in maintaining the reliability and efficiency of cloud infrastructure for HAS.

In addition to the cloud oversight responsibilities, the role is responsible for establishing and operationalizing a data management and data quality framework for the HAS data product. The role will collaborate with the Data Platform Product Manager to define data governance standards, implement automated quality controls, and ensure data assets are accurate, reliable, and fit for purpose.

Responsibilities

Cloud Infrastructure Management:
Deploy, configure, and maintain cloud infrastructure on AWS, Azure, or Google Cloud Platform platforms
Manage compute resources, storage systems, networking, and security configurations
Implement and maintain infrastructure as code using tools like Terraform, CloudFormation, or ARM templates
Optimize cloud resource utilization and manage cost efficiency initiatives
Maintain documentation of infrastructure architecture, configurations, and procedures

Monitoring and Incident Response:
Implement and maintain monitoring solutions for infrastructure, applications, and data pipelines
Configure alerts and dashboards using tools like CloudWatch, Azure Monitor, Datadog, or similar
Coordinate with cross-functional teams to respond to incidents, outages, and performance issues and assist with incident resolution

Automation and DevOps:
Develop and maintain automation scripts using Python, PowerShell, or Bash
Implement CI/CD pipelines for infrastructure deployment and application releases
Automate routine operational tasks to improve efficiency and reduce manual effort

Security and Compliance:
Implement and maintain security controls for cloud infrastructure and data platforms per Quest policies
Ensure compliance with HIPAA, HITRUST, SOC 2, and other regulatory requirements
Maintain audit logs and support compliance reporting activities
Coordinate with security and compliance teams on assessments and audits

Data Management and Platform Operations:
Support data platform infrastructure including data warehouses (Snowflake, Redshift), data lakes, and ETL systems
Monitor data pipeline performance and troubleshoot processing issues
Manage the data quality framework include quality rules, monitoring standards, and issue resolution process
Implement automated data validation and monitoring controls across ingestion, transformation, and delivery pipelines
Partner with Data Platform management to define and develop data quality KPI reporting
Implement data retention and archival policies
Manage database systems, backup and recovery procedures
Optimize query performance and resource allocation for analytical workloads
Coordinate with data engineering teams on platform upgrades and maintenance
Implement data retention and archival policies

Performance Optimization:
Monitor system performance metrics and identify optimization opportunities
Conduct capacity planning and resource scaling activities
Optimize infrastructure costs through rightsizing, reserved instances, and resource cleanup

Collaboration and Support:
Partner with data engineering, analytics, and development teams on infrastructure requirements
Provide technical guidance and support for cloud infrastructure questions
Collaborate with vendors and cloud service providers on technical issues
Support deployment activities and release coordination
Create and maintain technical documentation and knowledge base articles
Train team members on cloud operations procedures and best practices

Qualifications

Required Work Experience:
3+ years of experience in cloud operations, DevOps, or systems administration
3+ years of experience in data management, data quality, data governance, or data engineering within a production analytics environment
Hands on experience designing and implementing data quality controls across ingestion, transformation, and reporting layers
Experience defining and operationalizing data governance standards, including data ownership, business definitions, and critical data elements
2+ years of hands-on experience with major cloud platforms (AWS, Azure, or Google Cloud Platform)
Experience deploying and managing production infrastructure in cloud environments
Proven track record of managing highly available, scalable systems
Experience with infrastructure as code and automation tools
Experience supporting data platforms or analytics workloads
Background in healthcare, life sciences, or regulated industries with compliance requirements

Preferred Work Experience:
5+ years of cloud operations or DevOps experience
Multi-cloud experience (AWS, Azure, and/or Google Cloud Platform)
Experience with containerization and orchestration (Docker, Kubernetes, ECS)
Background supporting Snowflake, Redshift, BigQuery, or other cloud data warehouses
Experience with observability platforms (Datadog, New Relic, Splunk, or similar)
Previous experience in healthcare with HIPAA compliance
Experience with data pipeline orchestration tools (Airflow, dbt, Prefect)
Experience implementing automated data quality monitoring tools (rule engines, pipeline validations, anomaly detection)
Experience building and maintaining data dictionaries, metadata repositories, and lineage documentation
Experience supporting AI/ML or advanced analytics use cases requiring high data accuracy and consistency

Knowledge, Skills, and Abilities:

Cloud Platform Expertise:
Strong knowledge of AWS services (EC2, S3, RDS, Lambda, CloudWatch, IAM) or equivalent Azure/Google Cloud Platform services
Understanding of cloud networking (VPC, subnets, security groups, load balancers, DNS)
Experience with cloud security best practices and identity management
Knowledge of cloud cost optimization strategies and tools
Familiarity with cloud compliance frameworks and controls

Infrastructure and Automation:
Proficiency with infrastructure as code tools (Terraform, CloudFormation, ARM templates, Pulumi)
Strong scripting skills in Python, PowerShell, or Bash
Experience with CI/CD tools (Jenkins, GitLab CI, GitHub Actions, Azure DevOps)
Knowledge of configuration management tools
Understanding of version control systems (Git) and branching strategies

Data and Database Systems:
Understanding of data warehouse technologies and SQL query optimization
Experience with database administration for cloud databases
Knowledge of ETL/ELT processes and data pipeline architectures
Understanding of data security and encryption requirements

Monitoring and Troubleshooting:
Experience implementing monitoring and alerting solutions
Strong troubleshooting and analytical skills for complex technical issues
Ability to read and analyze logs, metrics, and traces
Experience with APM tools and distributed tracing
Knowledge of incident management and post-mortem processes

Security and Compliance:
Understanding of HIPAA, HITRUST, SOC 2, and other healthcare compliance requirements
Knowledge of security best practices for cloud infrastructure
Experience implementing security controls and conducting security assessments
Familiarity with vulnerability management and patch management processes

Data Management:
Strong understanding of data quality dimensions and how to implement measurable controls
Ability to define data quality rules aligned to business requirements and translate them into technical validation checks
Knowledge of data lifecycle management, including ingestion, transformation, storage, archival, and consumption

Required Education:

Bachelor's degree in computer science, Information Technology, Engineering, or related technical field, or equivalent work experience

Preferred Education:

Master's degree in computer science, Information Technology, or related field

Preferred Certification:

Cloud certifications (AWS Solutions Architect, Azure Administrator, Google Cloud Professional, or equivalent), DevOps or Infrastructure certifications, ITIL Foundation, or security certifications (Security+, CISSP)

About the Team

Quest Diagnostics honors our service members and encourages veterans to apply.

While we appreciate and value our staffing partners, we do not accept unsolicited resumes from agencies. Quest will not be responsible for paying agency fees for any individual as to whom an agency has sent an unsolicited resume.

Equal Opportunity Employer: Race/Color/Sex/Sexual Orientation/Gender Identity/Religion/National Origin/Disability/Vets or any other legally protected status.