Data Engineer with Clickhouse

Bellevue, WA, US • Posted 1 hour ago • Updated 1 hour ago
Contract W2
12 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Data Engineer
  • Azure
  • Clickhouse
  • Apache Hadoop
  • ADF
  • Databricks
  • HDFS
  • SQL
  • Python
  • Microsoft Azure

Summary

Job Description

Mandatory Primary Skills: Hadoop, Python, Databricks, Click house DB , ADLS, SQL + Azure cloud technologies above all with Azure (such as ADF, Databricks, Log Analytics, Logic App, Key Vault, Blob Storage, ADLS, etc.)

Secondary Skills: Snowflake ,

 

Detailed JD as below.

  • We run a near real-time analytics platform for mobile network data, ingesting billions of rows a day from Azure Data Lake/HDFS into Click House and serving subscriber-level queries back to internal APIs in tens of milliseconds. We are expanding the platform footprint to support additional use cases by adding more datasets
  • Data Engineer would work on: extending the Python ingestion framework that loads from Azure Data Lake/HDFS; table design covering partitioning, sort keys, TTL and materialized views; operational diagnosis of merge behaviour, part counts and replication lag; and integration with Snowflake and Databricks Iceberg alongside the primary feeds.
  • We need strong analytical SQL and experience with a columnar or MPP database — Click House, Big Query, Redshift or similar.
  • Python sufficient to own a production ingestion framework rather than write scripts.
  • Comfort at hundreds of billions of rows, since the failure modes differ from smaller systems.
  • Cloud object storage and Parquet. Enough Kubernetes to tell whether a problem is the database or the platform underneath it.
  • Strongly preferred: direct Click House experience, particularly Merge Tree engines and aggregate function states, and telecom data such as DNS , IPFIX, etc.
  • Click House specifically is uncommon, and we would rather have a strong engineer from an adjacent system than a weak one with the exact keyword.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099677
  • Position Id: 9093055
  • Posted 1 hour ago
Contact the job poster
AK

Anuradha Karod

Recruiter @ Talent Groups
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Yesterday

Easy Apply

Full-time

140000 - 155000

Remote

27d ago

Full-time

No location provided

29d ago

Full-time

No location provided

Today

Full-time

Search all similar jobs