Senior Kafka & Flink Engineer (AWS)

Job Title - Senior Kafka & Flink Engineer (AWS)

Location - Austin , TX

Duration - 12+ Months 

Note - This is a W-2 position, and we welcome candidates requiring H-1B transfer sponsorship to apply. No third-party vendors.

W2 Benefits - Health Insurance (Medical, Dental, Vision), Employee 401 K Contributions, HSA and other Benefits.

Key Responsibilities

· Design and develop real-time transaction processing systems with end-to-end latency requirements below 300 milliseconds.

· Build highly resilient and scalable architectures capable of enriching transactions from approximately 10+ on-premises and cloud-based data sources.

· Develop and maintain event-driven streaming solutions using:

o Apache Kafka

o Apache Flink

o Kong API Gateway

· Build and support real-time integrations using:

o AWS Glue

o AWS Lambda

o Amazon EventBridge

o HVR (Five Tran HVR)

· Design, build, and consume high-performance REST APIs using .NET/.NET Core.

· Implement resilient messaging, event processing, monitoring, and fault-tolerant patterns.

· Collaborate with cloud, infrastructure, and security teams to ensure scalability and reliability.

· Optimize system performance to meet stringent SLAs and low-latency requirements.

Required Technical Skills

Real-Time Processing

· Proven experience building real-time distributed systems.

· Demonstrated experience delivering transaction round-trip times under 300 milliseconds.

· Experience enriching transactions using multiple internal and external data sources.

Streaming & Messaging

· Apache Kafka

o Topic design

o Consumer groups

o Stream processing

o Custom Kafka business logic

· Apache Flink

o Stateful stream processing

o Event-time processing

o Windowing

o Low-latency data pipelines

API & Integration Technologies

· Kong API Gateway

· REST APIs

· Microservices Architecture

· .NET / .NET Core / C#

AWS Technologies

· AWS Glue

· AWS Lambda

· Amazon EventBridge

· Cloud-native event-driven architectures

· Integration between on-premises and cloud platforms

Data Replication & Integration

· HVR (High Volume Replication/Fivetran HVR)

· Real-time data synchronization and replication strategies

Security & Network Intelligence Requirements

The candidate should possess experience in:

· IP reputation and risk analysis

· Identifying and classifying traffic originating from:

o TOR networks

o Proxy servers

o VPN services

· Fraud detection or cybersecurity-related enrichment services

· Integration of threat intelligence and geolocation services into transaction workflows

Preferred Qualifications

· Experience in payments, fintech, banking, fraud prevention, or risk management systems.

· Experience operating systems with high transaction volumes and strict SLA requirements.

· Strong understanding of resiliency patterns, fault tolerance, and distributed architectures.

· Knowledge of observability, monitoring, and performance tuning.