Java Streaming Tech Lead

Overview

Hybrid
$160,000 - $215,000
Full Time
10% Travel

Skills

Java
python
Flink
Kafka
Plantir
Spark
PCF

Job Details

Responsibilities:

  • Lead technical design and implementation of Flink and Kafka event driven use cases
  • Ensure best practices are followed for performance tuning, security, and data governance
  • Build awesome big data products within a fun team where culture is the foundation for success
  • Lead and mentor the development team in a hands-on way
  • Provide technical feasibility assessment while collaborating with Product Owner and Design team to guide features and provide technical know-how
  • Define and address application non-functional requirements, and manage technical debt
  • Debug and optimize complex applications
  • Effectively communicate the vision and architecture to team members
  • Maintain a productive working environment for development teams
  • Be a strong advocate for a culture of quality across the team
  • Collaborate with external teams, especially security, to design, implement and support solutions that are scalable and efficient
  • Build best-in-class real time analytics products with Flink and Kafka
  • Effectively communicate the solution to non-technical stakeholders
  • Follow an agile development methodology
  • Keep up-to-date with the Flink and Kafka capabilities of Palantir Foundry releases, features and best practices and recommend changes to improve efficiency, performance and scalability
  • Advocate for appropriate data modeling techniques to enable agile development and the business use cases, specifically in the integration of event-driven with batch data processing

Minimum Qualifications:

  • Implement component
  • Proficiency with Spark
  • Experience with Flink or Kafka
  • Data bricks
  • Deep Technical experience
  • Experience in Plantir Foundry releases
  • Lead the design and implementation of Flink and Kafka event
  • Take care of system solution architecture development.
  • Previous project and portfolio focused in any of the following, Cloud Architecture, Data Management, Security and Microservices
  • Expert level Data engineer with mentorship program