Data Engineer

Overview

On Site
Depends on Experience
Full Time

Skills

Apache Kafka
Google Cloud Platform
Microsoft Azure
PyTorch
Python
NumPy
Kronos
Flink
KDB+

Job Details

  • 8+ years of experience in data engineering, with a focus on large-scale and high-throughput systems

  • Deep experience working with time series data and purpose-built storage systems (e.g., KDB+, TimeSet, Kronos)

  • Strong experience building streaming and batch data pipelines using tools like Glue, Kafka, Flink, or Spark

  • Proficiency in Python and integrating data pipelines with machine learning workflows and libraries (e.g., pandas, NumPy, scikit-learn, PyTorch)

  • Experience designing efficient, scalable data models and partitioning strategies for time series data

  • Knowledge of distributed systems, columnar databases, and parallel processing

  • Familiarity with cloud-native data architectures (AWS, Google Cloud Platform, or Azure) and containerized data infrastructure

  • Strong understanding of data quality, lineage, monitoring, and observability tools

  • Excellent communication skills and a proactive, consultative mindset in client-facing environments

  • Bonus: Experience with multiple time series systems (e.g., KDB+ and Kronos) or contributing to open-source data infrastructure projects

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Application Management Services LLC