Senior Big Data DevOps Engineer (Kafka/AWS)
NEXIFY INFOSYSTEMS LLC
Dice Job Match Score™
🎯 Assessing qualifications...
Job Details
Skills
- BigData
- hadoop
- Devops
- kafka
Summary
Job Title: Senior Big Data DevOps Engineer (Kafka/AWS)
Location: Denver, CO or St. Louis, MO
Duration : 12 Months
Job Summary
Experienced Big Data Administrator responsible for managing, supporting, automating, and optimizing enterprise-scale Hadoop, Kafka, AWS cloud, and DevOps platforms. The role focuses on ensuring high availability, performance, security, scalability, and operational excellence across big data ecosystems while collaborating with development, architecture, and business teams.
Key Responsibilities:
Kafka Administration
Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.
Monitor broker health, partitions, replication factors, and consumer lag.
Perform capacity planning and cluster scaling activities.
Manage Kafka security using SSL, SASL, ACLs, and encryption standards.
Troubleshoot producer, consumer, and broker performance issues.
Support Kafka Connect, Schema Registry, Cruise Control, and MirrorMaker implementations.
AWS Cloud Administration
Manage cloud infrastructure services including EC2, S3, IAM, VPC, EBS, CloudWatch, CloudTrail and AWS Glue.
Support AWS Managed Streaming for Kafka (MSK), EMR, Lambda, and Airflow environments.
Implement cloud security best practices and governance controls.
Perform infrastructure provisioning and automation using Infrastructure as Code (IaC).
Monitor cloud resource utilization and optimize operational costs.
DevOps & Automation
Design and maintain CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools.
Automate infrastructure deployment using Terraform, CloudFormation, and Ansible.
Manage source control repositories and release processes.
Implement monitoring and alerting solutions using Prometheus, Grafana, Splunk, ELK, or CloudWatch.
Support containerization technologies such as Docker and Kubernetes.
Develop automation scripts using Python, Shell, or Bash.
Operations & Support
Provide Level 2 and Level 3 production support.
Participate in on-call support rotations and incident management activities.
Perform root cause analysis (RCA) and implement preventive measures.
Create and maintain operational documentation and standard operating procedures.
Ensure compliance with security, audit, and regulatory requirements.
Required Skills
Apache Kafka Administration
AWS Cloud Services
Linux (RHEL/Rocky Linux)
Shell Scripting and Python
Jenkins, Git, Ansible, Terraform
Docker and Kubernetes
Monitoring Tools (Grafana, Prometheus, Splunk)
Networking, Security, and High Availability Concepts
Performance Tuning and Capacity Planning
Preferred Qualifications
Bachelor’s degree in Computer Science, Information Technology, or related field.
Experience with Cloudera CDP, AWS MSK, Airflow, and Spark.
AWS, Google Cloud Platform, Kafka, or Kubernetes certifications.
Experience supporting large-scale production environments handling petabyte-scale data workloads.
Key Achievements Expected
Maintain platform availability above 99.9%.
Adopt AI-assisted engineering practices to improve operational efficiency, reduce manual effort, and accelerate troubleshooting and documentation.
Automate repetitive operational tasks.
Improve cluster performance and resource utilization.
Ensure secure, scalable, and reliable data platform operations.
Support enterprise data engineering, analytics, and AI/ML workloads efficiently.
- Dice Id: 91164179
- Position Id: 9030714
- Posted 18 hours ago
Company Info
About NEXIFY INFOSYSTEMS LLC
At Nexify InfoSystems, we go beyond the conventional definitions of consulting and staffing—we are the architects of transformation, shaping the future of businesses with innovation, precision, and impact. Our dedicated team of industry experts and certified professionals is committed to delivering cutting-edge IT solutions that span a broad spectrum of capabilities, including Automation, Artificial Intelligence, Data Engineering, Cloud Computing, Cybersecurity, Technology Consulting, and Advanced Talent Screening. With a foundation rooted in excellence and a relentless drive for innovation, we develop bespoke strategies designed to help businesses realize their full potential. Whether navigating complex challenges or seizing emerging opportunities, our approach ensures that every solution is aligned with your unique vision and objectives.
At Nexify, we believe in building lasting relationships anchored in trust, collaboration, and measurable impact. We don’t just address immediate needs or challenges; we create sustainable pathways to growth and success. By turning complexity into opportunity, we deliver solutions that not only solve problems but also position businesses for long-term resilience and leadership in their industries.
Our partnerships represent a legacy of success, a testament to our unwavering commitment to delivering enduring value. Together, let’s transform your aspirations into actionable outcomes and redefine what’s possible for your organization. With Nexify InfoSystems, the future isn’t just anticipated—it’s designed.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs