Overview
Remote
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Unable to Provide Sponsorship
Skills
NiFi SME Nifi Administration
optimization
production support Linux Administration
CI/CD PipelinesAWS
Azure
GCP
Docker
Kubernetes
Data flow
Bash
Python
Prometheus
Grafana
NiFi
RegEx
ETL
Job Details
Platform Engineer- NiFi SME
100% Remote- Must be able to work on MST
Technical Requirements:
- NiFi Administration: Managing dedicated NiFi clusters, providing backend and infrastructure support, and developing ETL processes within cluster environments.
- Linux Expertise: Strong Linux system knowledge is essential, as all systems operate on Linux.
Preferred Skills:
- Programming & Scripting: Experience with regular expressions (RegEx) for ETL field processing and Bash scripting.
- AWS Skills (Preferred): Familiarity with S3 (data lakes), F3, and Athena.
- Monitoring Tools: Uses Datadog for monitoring easy to learn if unfamiliar.
We are seeking a highly skilled Senior Platform Engineer specializing in Apache NiFi administration and Linux systems. This role involves designing, deploying, and maintaining robust data flow solutions and ensuring operational stability across our platform infrastructure.
Key Responsibilities:
- Administer, configure, and optimize Apache NiFi clusters for high availability and performance.
- Design and implement secure, scalable data flows across diverse data sources.
- Manage Linux servers, ensuring system health, security, and efficiency.
- Develop automation scripts for deployment, monitoring, and maintenance tasks.
- Collaborate with cross-functional teams to support data-driven initiatives.
- Troubleshoot and resolve complex system issues related to NiFi and Linux environments.
Qualifications:
- Bachelors degree in Computer Science, Engineering, or related field (or equivalent experience).
- 5+ years of experience in platform engineering or systems administration.
- Expertise in Apache NiFi administration and data flow management.
- Proficiency in Linux system administration (RedHat, Ubuntu, etc.).
- Strong scripting skills (Bash, Python) and automation experience.
- Familiarity with monitoring tools (Prometheus, Grafana) and CI/CD pipelines.
- Excellent problem-solving abilities and communication skills.
Preferred Skills:
- Experience with cloud platforms (AWS, Azure, Google Cloud Platform).
- Knowledge of containerization (Docker, Kubernetes).
- Understanding of security best practices in data flow management.
Technical Requirements:
Required Skills : Need a NiFi SME Nifi Administration, optimization, production support Linux Administration CI/CD Pipelines
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.