Overview
Remote
Depends on Experience
Contract - Independent
Skills
Apache NiFi in enterprise environments
including setup
flow development
tuning
and production support.
Job Details
Immediate interviews. Remote
Integration engineer NiFi
Software Engineer with 6–7 years of hands-on experience in Apache Knife and related technologies such as Kafka, Kubernetes, and OpenID-based identity providers. This role is responsible for designing, deploying, and managing scalable, secure, and production-grade NiFi integrations across the enterprise. The candidate must have extensive experience working with real-world data sources and implementing secure authentication and authorization through platforms like Okta using OpenID Connect (OIDC) or SAML.
Key Responsibilities
- Architect, configure, and manage an enterprise-scale Apache NiFi platform supporting secure, high-volume data workflows.
- Design and implement real-life integrations using NiFi with a wide range of data sources, including databases, email systems, EDI formats, Excel, CSV files, and REST APIs.
- Build and optimize complex data flows in NiFi, including data transformation, enrichment, routing, and orchestration.
- Implement authentication and access control for NiFi using Okta, OpenID Connect (OIDC), or SAML-compliant identity providers.
- Integrate NiFi with Apache Kafka to support real-time and batch processing pipelines.
- Deploy and operate NiFi in Kubernetes environments using tools like Helm, with automated CI/CD support.
- Set up observability tooling to monitor flow health, performance metrics, and system reliability.
- Collaborate with data engineering, security, and DevOps teams to meet business and compliance requirements.
- Maintain high-quality technical documentation and provide guidance to internal teams on NiFi best practices.
Required
- 6–7 years of hands-on experience with Apache NiFi in enterprise environments, including setup, flow development, tuning, and production support.
- Strong experience with real-world integrations across various data formats and sources, such as SQL/NoSQL databases, EDI (X12/EDIFACT), email (SMTP/IMAP), Excel, CSV, and APIs.
- Experience integrating NiFi with Apache Kafka for message-based or event-driven architectures.
- Proficient in deploying and managing NiFi in Kubernetes environments using Helm and infrastructure-as-code tools.
- Deep understanding of security best practices, including TLS/SSL, encryption, secure credential handling, and RBAC.
- Hands-on experience implementing authentication and authorization in NiFi using OpenID Connect (OIDC), Okta, or similar identity providers.
- Proficient in scripting (Python, Bash, Groovy) for workflow customization and automation.
- Solid understanding of structured and semi-structured data formats (JSON, XML, flat files).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.