Data Engineer - Kafka Streaming

Must Have:

• Need to have strong working knowledge on Linux platform
• Application Development Exp - Python (#1) - Ruby or Shell (#2)
• Need to be able to run the application within Linux - debug - understand when they run the application there is a memory cpu, etc
• ELK (Elastic Search) Exp
• Kafka building pipeline with ELK and Kafka
• Strong communication, Team Player and someone who is open to learning and getting their hands dirty.
• Ability to learn - Curiosity
• This person will not only be doing the pipeline development, but will work in large sacle cluster setting.
• Will requires the understanding of scalability in the kafka environment
• This person will ensure the jobs are up and running, debug it and support the 100s of customers who use their system
• Be the person to support those people
• Pipeline development using Kafka, ELK and Hycon
• Will need a strong knowledge of linux because that s where they deploy their jobs in the 100s
• Pipeline is within kafka and almost all the data is writing within ELK (need to understand how the data is stored)
• This is a diverse background!
• Years of experience: 7-15 years Exp

Good to Have:

• Fling
• Snowflake Database Exp
• Spark Data processing
• Good Data Analysis Background
• ELK Certification
• Observability and Data Analysis

Education: Bachelor's Degree.

About US Tech Solutions: US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit ;br />US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Recruiter Details: Name: Deepak Kumar
Email: