Job Title - Senior Kafka & Flink Engineer (AWS)
Location - Austin , TX
Duration - 12+ Months
Note - This is a W-2 position, and we welcome candidates requiring H-1B transfer sponsorship to apply. No third-party vendors.
W2 Benefits - Health Insurance (Medical, Dental, Vision), Employee 401 K Contributions, HSA and other Benefits.
Key Responsibilities
· Design and develop real-time transaction processing systems with end-to-end latency requirements below 300 milliseconds.
· Build highly resilient and scalable architectures capable of enriching transactions from approximately 10+ on-premises and cloud-based data sources.
· Develop and maintain event-driven streaming solutions using:
o Apache Kafka
o Apache Flink
o Kong API Gateway
· Build and support real-time integrations using:
o AWS Glue
o AWS Lambda
o Amazon EventBridge
o HVR (Five Tran HVR)
· Design, build, and consume high-performance REST APIs using .NET/.NET Core.
· Implement resilient messaging, event processing, monitoring, and fault-tolerant patterns.
· Collaborate with cloud, infrastructure, and security teams to ensure scalability and reliability.
· Optimize system performance to meet stringent SLAs and low-latency requirements.
Required Technical Skills
Real-Time Processing
· Proven experience building real-time distributed systems.
· Demonstrated experience delivering transaction round-trip times under 300 milliseconds.
· Experience enriching transactions using multiple internal and external data sources.
Streaming & Messaging
· Apache Kafka
o Topic design
o Consumer groups
o Stream processing
o Custom Kafka business logic
· Apache Flink
o Stateful stream processing
o Event-time processing
o Windowing
o Low-latency data pipelines
API & Integration Technologies
· Kong API Gateway
· REST APIs
· Microservices Architecture
· .NET / .NET Core / C#
AWS Technologies
· AWS Glue
· AWS Lambda
· Amazon EventBridge
· Cloud-native event-driven architectures
· Integration between on-premises and cloud platforms
Data Replication & Integration
· HVR (High Volume Replication/Fivetran HVR)
· Real-time data synchronization and replication strategies
Security & Network Intelligence Requirements
The candidate should possess experience in:
· IP reputation and risk analysis
· Identifying and classifying traffic originating from:
o TOR networks
o Proxy servers
o VPN services
· Fraud detection or cybersecurity-related enrichment services
· Integration of threat intelligence and geolocation services into transaction workflows
Preferred Qualifications
· Experience in payments, fintech, banking, fraud prevention, or risk management systems.
· Experience operating systems with high transaction volumes and strict SLA requirements.
· Strong understanding of resiliency patterns, fault tolerance, and distributed architectures.
· Knowledge of observability, monitoring, and performance tuning.
Never miss an opportunity! Create an alert based on the job you applied for.
