Overview
Skills
Job Details
Data Engineer Streaming exp
Location 9800 Fredericksburg Rd, San Antonio, TX, 78288 (Hybrid)
Start Date Immediate
Must-Have Skills:
Extensive experience (10+ years) with event streaming platforms (Kafka preferred), stream processing frameworks (Flink, Spark Streaming), and data serialization formats (Avro, Protobuf, JSON).
Deep understanding of event-driven architectures, CQRS, and event sourcing.
Extensive experience with ETL/ELT tools, specifically Fivetran; demonstrated ability to design, implement, and optimize Fivetran-based data pipelines. This includes experience with connector configuration, data transformation, and schema management within Fivetran.
Proficiency in monitoring and observability tools (Datadog, Prometheus, Grafana, or similar).
Strong experience with Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation).
Proven ability to automate tasks and implement CI/CD pipelines.
Strong problem-solving and communication skills.
Nice-to-Have Skills:
Experience with cloud-based streaming services (AWS Kinesis, Azure Event Hubs, Google Cloud Platform Pub/Sub).
Experience with application development frameworks (Spring Boot, Node.js, etc.).
Familiarity with Kubernetes and container orchestration.
Experience with various database technologies (SQL and NoSQL).
Real-time analytics and dashboarding experience.