Data Engineer with Streaming or Flink exp

• Role: Data Engineer with streaming or flink exp
• Location: MTV/San Diego CA (100% Onsite)
• Job Type: Contract
• No of interview : 2 ( 1 Video interview , 2^nd In person interview)

Must have:

• Expertise in Apache Flink or streaming exp
• Strong programming skills in Java
• Knowledge of stream processing and batch processing
• Experience working with Apache Kafka.
• Proven experience with projects in Apache Flink production Java or Scala
• Knowledge of relational databases.
• Knowledge of MPP like AWS Athena
• Knowledge of HIVE
• Experience of AWS cloud services

What You'll Do:

• Work on writing new data pipelines.
• Debug and optimize existing data pipelines.
• Analyze pipelines consuming high resources or having high execution time and optimize as needed
• Implementation for automating pipeline management and metrics setup for observability
• Gather requirements, work on high level design, implement (code) and deliver efficient and scalable DW solutions in high data growth environment
• Oversee team activities related to coding, unit testing, system testing, resolve defect originating during system test and deploy the fixes for the defects when needed

Good to Have

• Familiarity with big data technologies like Spark, Hive
• Familiarity with CI/CD and basic dev ops.
• Familiarity with shell scripting