Sr. Data Engineer

Overview

Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - Long Term

Skills

Python
sql
kafka
datastage

Job Details

Title: Sr. Data Engineer-(Kafka, SQL and Python)

San Antonio, TX-We are fine with initial remote not 100%remote

Location
About the Data Engineer Role:

As an Engineer on our group, you will be working with our Agile teams building applications to configure and run data quality rules and controls on streaming data. Responsible for the development of re-usable services for designing and delivering next generation event processing, alerting and analytics system. Design and develop distributed, high volume, high velocity multi-threaded event processing system.


Responsibilities

  • Experience in streaming application and Realtime analytics (must)
  • Hands-on experience in Kafka (must)
  • Hands-on experience in Java, Python (must)
  • Working experience in databases Netezza, Oracle, Snowflake
  • Very Good in writing SQLs, advance SQL for analytics
  • Experience win ELK is good to have
  • Experience in Dockers and OpenShift good to have.
  • Experience in data quality, data profiling and information governance good to have


Requirements:

  • Bachelor's Degree or master's degree in Computer Science, Mathematics, Statistics.
  • 5+ years of experience with KAFKA streaming application
  • 5+ years of Object-Oriented Programming using Java and Python.
  • Experience with design and implementations of cloud-ready applications and deployment pipelines on large-scale container platform clusters is a plus
  • Experience working in a Continuous Integration and Continuous Delivery environment and familiar with Jenkins, Artifactory, Code Quality Tools SonarQube etc.
  • Proficient in writing Optimal multithreaded applications.
  • 5+ Years of complex SQL / PL SQL development experience
  • Experience working in Agile framework
  • Knowledge of industry wide technology strategies and best practices

Top 3 Skills

Kafka, DataStage, SQL