Overview
Skills
Job Details
Job Title: Apache Flink Streaming Developer / Lead
Location: 1 Pershing Plaza, Jersey City, NJ (Hybrid)
Type: Long-Term Contract
Job Summary:
We are looking for a highly skilled and motivated Lead Software Engineer with deep hands-on experience in Apache Flink to lead the development of scalable, real-time streaming applications. The ideal candidate will play a pivotal role in designing, building, and optimizing distributed data pipelines, while also providing technical leadership and mentorship to the engineering team. This is a hybrid role based in Jersey City, NJ, offering the opportunity to work on cutting-edge stream processing systems in a collaborative and agile environment.
Key Responsibilities:
- Design and Development
- Architect and implement fault-tolerant, low-latency, and high-throughput real-time streaming solutions using Apache Flink
- Develop and optimize data ingestion, transformation, and analytics pipelines
- Write clean, modular, and testable code in Java or Scala
- Build and maintain CI/CD pipelines for deploying and managing streaming applications
- Technical Leadership
- Lead design discussions, code reviews, and system architecture decisions
- Mentor junior developers and promote a culture of engineering excellence
- Define and enforce best practices and stream processing standards
- Evaluate new tools and frameworks to improve the streaming infrastructure
- Performance Optimization
- Monitor and fine-tune Flink applications for reliability and efficiency
- Resolve complex technical issues, conduct performance benchmarking
- Configure and optimize Flink cluster settings for resource usage and job latency
- Collaboration & Agile Delivery
- Collaborate with product managers, data engineers, and data scientists to understand business needs and translate them into scalable solutions
- Communicate effectively across technical and non-technical stakeholders
- Participate in Agile ceremonies, planning, and delivery sprints
- Data Architecture
- Integrate streaming pipelines with data lakes, warehouses, and other systems
- Define data models and schemas optimized for streaming use cases
- Work with messaging systems like Kafka and RabbitMQ for stream input/output
Required Qualifications:
- Bachelor s or Master s degree in Computer Science, Engineering, or a related field
- 7+ years of software development experience, including 3+ years of hands-on Flink development
- Expertise in Apache Flink, stream processing concepts, and real-time data architecture
- Strong skills in Java or Scala
- Experience working with distributed systems and cloud platforms (AWS, Google Cloud Platform, or Azure)
- Proficiency in message brokers like Kafka, RabbitMQ
- Hands-on experience with CI/CD pipelines (e.g., Jenkins, GitLab CI, CircleCI)
- Excellent problem-solving and communication skills
Preferred Qualifications:
- Experience with other stream processing technologies (e.g., Kafka Streams, Spark Streaming)
- Familiarity with Docker and Kubernetes
- Experience with SQL/NoSQL databases and data warehousing solutions
- Exposure to monitoring/logging tools (e.g., Prometheus, Grafana, Splunk)
- Contributions to open-source projects, especially related to Flink
Work Model:
- Hybrid (Onsite + Remote) Candidate must be available to work from the Jersey City office as needed.