Apache Kafka Developer with AWS MSK (Amazon Managed Streaming)

  • Posted 60+ days ago | Updated 6 hours ago

Overview

Remote
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Kafka
Apache
AWS
MSK
Amazon Managed Streaming
Terraform
EC2
ELB
RDS
Route53
S3
VPC
VPN
TGW

Job Details

Job Title: Apache Kafka Developer with AWS MSK (Amazon Managed Streaming)

Location: FULLY Remote

Position type: Long term Contract

Rate: DOE

 

Job Description:-

We need two senior (10+ Years) Apache Kafka developers with experience in AWS MSK (Amazon Managed Streaming for Apache Kafka) as well as  Well-versed on MSK Connect and Kafka Connect for integration with RDBMS, using JDBC connectors and Hands-on experience in Terraform.

They must also have experience with AWS services (EC2, ELB, RDS, Route53, S3, VPC, VPN, TGW);

 

Candidates Must Have:

  1. Kafka
  2. AWS/ MSK
  3. Terraform
  4. AWS services (EC2, ELB, RDS, Route53, S3, VPC, VPN, TGW);
  5. Heavy Data experience

 

Job Description:

Minimum 10 years of IT experience

Minimum of 7 years of hands-on experience within data engineering organization;

Experience designing and operating solutions with relational Databases (Oracle, Postgres, SQL Server);

Self-motivated and able to work with minimal supervision;

Familiar with the creation of different types of documentation like functional, process, test plan etc;

Experience in AWS MSK (Amazon Managed Streaming for Apache Kafka);

Well-versed on MSK Connect and Kafka Connect for integration with RDBMS, using JDBC connectors;

Hands-on experience in Terraform;

Experience in primary AWS services (EC2, ELB, RDS, Route53, S3, VPC, VPN, TGW);

Strong AWS skills;

Strong track record of implementing AWS services in a variety of distributed computing environments;

Ability to install, maintain and troubleshoot Kafka;

Experience working with Apache Kafka, like designing, developing, and managing data streams, troubleshooting, internals, cluster design, optimization, monitoring, schema registry and schema evolution, REST API, and its many related components;

Extensive experience with messaging and stream processing on Kafka;

In-depth knowledge of all the functionalities surrounding Kafka;

Excellent understanding of SQL and Python for data processing;

Understanding of Data Modeling concepts and RDBMS Database design;

Ability to work with a variety of platforms and application stacks;

Experience working in an Agile/Scrum development process;

Bachelor’s Degree in Computer Science or Software Engineering.

 

Key Must Haves:

Experience in primary AWS services (EC2, ELB, RDS, Route53, S3, VPC, VPN, TGW)

Experience designing and operating solutions with relational Databases (Oracle, Postgres, SQL Server)

Strong track record of implementing AWS services in a variety of distributed computing environments

 

Skills Matrix:-

Total work experience in IT Industry: Years

Total work experience in USA: Years

Kafka: Years

AWS/ MSK (Amazon Managed Streaming): Years

Terraform: Years

AWS services (EC2, ELB, RDS, Route53, S3, VPC, VPN, TGW): Years