Senior Data DevOps Engineer

Overview

Full Time

Skills

DevOps
EDP
Storage
Amazon S3
Analytical Skill
Big Data
Oracle Policy Automation
RBAC
Workflow
High Availability
Scalability
Regulatory Compliance
Continuous Delivery
Collaboration
Kubernetes
Orchestration
Red Hat Linux
Apache Kafka
Apache HTTP Server
Apache Spark
Streaming
Management
SQL
Database
PostgreSQL
Terraform
Provisioning
GitLab
Continuous Integration
Access Control
Grafana
Leadership Development
Soft Skills
Google Cloud Platform
Google Cloud
Microsoft Azure
Amazon Web Services
LinkedIn
English

Job Details

We are looking for a talented and motivated Data DevOps Engineer to drive the operationalization and maintenance of an Enterprise Data Platform (EDP) Foundation, ensuring a seamless and secure environment for data-driven operations at scale.

This position offers remote setup with the flexibility to work from any location in Georgia, whether it's your home, well-equipped offices in Tbilisi and Batumi or a coworking space in Kutaisi.

TECHNOLOGIES
  • Data Platform Components
  • Apache Kafka
  • Apache Spark (including Spark Streaming)
  • MinIO (Object Storage compatible with S3)
  • Apache Iceberg (Table format for analytical datasets)
  • PostgreSQL
  • Trino (Distributed SQL query engine for big data)
  • Infrastructure & Security
  • Red Hat OS
  • Kubernetes for container orchestration
  • HashiCorp Vault for secrets and credential management
  • Open Policy Agent (OPA) for policy enforcement
  • Logging and Monitoring
  • LGTM stack (Loki, Grafana, Tempo, Mimir)

RESPONSIBILITIES
  • Install and configure platform components to streamline integration within the Enterprise Data Platform stack
  • Set up RBAC to enforce granular permissions and ensure adherence to security best practices
  • Design and maintain CI/CD pipelines using tools like GitLab CI, integrating infrastructure provisioning with technologies such as Terraform
  • Implement Logging and Monitoring capabilities with the LGTM stack for enhanced observability and performance tracking
  • Build and deploy a centralized Single Management Console for efficient platform management
  • Implement multi-tenancy capabilities to offer independent and secure environments for various users, teams, and locations
  • Automate data ingestion, transformation, and querying workflow pipelines
  • Optimize platform infrastructure using Kubernetes and RedHat OS to ensure high availability and scalability
  • Utilize HashiCorp Vault and Open Policy Agent to enforce robust security policies and maintain compliance standards
  • Work closely with engineers and platform teams to improve release processes and foster continuous delivery
  • Monitor, troubleshoot, and resolve issues to guarantee operational reliability and system performance
  • Collaborate with customer technical teams to meet project goals and milestones effectively

REQUIREMENTS
  • 3+ years of experience working with Kubernetes for container orchestration and Red Hat OS in enterprise environments
  • Experience with Apache Kafka, MinIO, Apache Iceberg, and Apache Spark, including Spark Streaming
  • Proficiency in managing distributed SQL query engines like Trino and databases such as PostgreSQL
  • Background in Terraform for infrastructure provisioning and GitLab CI or similar tools for automated deployment pipelines
  • Knowledge of HashiCorp Vault and Open Policy Agent for implementing secure access control and policy enforcement
  • Expertise in Logging and Monitoring tools, particularly the LGTM stack (Loki, Grafana, Tempo, Mimir)

WE OFFER
  • We connect like-minded people
    • Delivering innovative solutions to industry leaders, making a global impact
    • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
    • Opportunity to work abroad for up to two months per year
    • Relocation opportunities within our offices in 55+ countries
    • Corporate and social events
  • We invest in your growth
    • Leadership development, career advising, soft skills and well-being programs
    • Certifications, including Google Cloud Platform, Azure and AWS
    • Unlimited access to LinkedIn Learning and Get Abstract
    • Free English classes with certified teachers
  • We cover it all
    • Participation in the Employee Stock Purchase Plan
    • Monetary bonuses for engaging in the referral program
    • Comprehensive medical & family care package
    • Five trust days per year (sick leave without a medical certificate)
    • Benefits package (sports activities, a variety of stores and services)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.