Data Engineer (Local)

Jersey City, NJ, US • Posted 2 days ago • Updated 2 days ago
Contract W2
Contract Independent
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

  • PySpark/Apache
  • Flink
  • Data Mediation
  • Golang

Summary

Must Have Technical/Functional Skills:

  • System Architecture & Design Lead the design of scalable, fault-tolerant mediation
  • components including file ingestion, format conversion, SFTP distribution, event monitoring, and
  • downstream delivery pipelines.
  • Binary Protocol & Telecom Data Expertise Parse, decode, and transform binary telecom data
  • formats including ASN.1-encoded CDRs/UDRs, AMA (Automatic Message Accounting) records,
  • and proprietary carrier formats at the byte-stream level.
  • Java / Spring Boot Development Build and maintain core mediation services using Java 17+
  • and Spring Boot (Spring Integration, Spring Batch, Spring Kafka); contribute to shared starters
  • and reusable platform libraries.
  • Kubernetes / OpenShift Operations Design and deploy containerized workloads on
  • OpenShift/Kubernetes; own Helm chart definitions, resource tuning, PVC strategies, horizontal
  • scaling, and rolling upgrade policies.
  • Oracle Database Design and optimize schemas for high-volume mediation metadata,
  • reconciliation state, and audit trails; write and tune complex SQL for operational reporting.
  • Site Reliability Engineering (SRE) Define and enforce SLOs/SLIs; lead incident response; drive
  • post-mortems; implement error budgets and auto-remediation patterns into the platform.
  • Advanced Observability & Monitoring Build deep observability into the platform: structured
  • logging (Log back/ELK), distributed tracing (Open Telemetry/Jaeger), metrics
  • (Micrometer/PrometheGrafana), and alerting strategies for carrier-grade availability.
  • Performance & Reliability Engineering Profile and optimize JVM performance, Kafka consumer
  • throughput, file I/O pipelines, and database query patterns; establish benchmarks and
  • regression gates.
  • Cross-Team Technical Leadership Drive architectural decisions, conduct design reviews,
  • mentor engineers, and collaborate with network, OSS/BSS, and downstream consumer teams.
  • Roles & Responsibilities
  • Hands-on experience with ASN.1 decoding, AMA record parsing, binary CDR/UDR
  • formats (3GPP, ANSI), and byte-stream manipulation
  • Strong Kubernetes and OpenShift skills: Helm, resource policies, stateful workloads, network
  • policies, operator patterns
  • Proficient in Oracle SQL and PL/SQL: schema design, indexing strategies, partitioning, explain
  • plans
  • SRE mindset: SLO/SLI definition, on-call discipline, chaos engineering fundamentals, capacity
  • planning
  • Experience building production-grade observability: Prometheus, Grafana, Open Telemetry,
  • ELK/EFK, alerting pipelines
  • Demonstrated ability to debug and resolve issues at the system level OS, JVM, network, file
  • descriptor limits, pressure, thread contention
  • Experience with Apache Kafka at scale: partition strategy, consumer group tuning, offset
  • management, dead-letter handling
  • Solid understanding of SFTP, S3/object storage, file lifecycle management, and large-scale file
  • distribution patterns
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10119106
  • Position Id: 8988324
  • Posted 2 days ago
Contact the job poster
MK

Mohan Kanala

Recruiter @ New York Technology Partners
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Jersey City, New Jersey

Today

Easy Apply

Contract

Depends on Experience

New York, New York

Today

Contract

USD 70.00 - 79.71 per hour

Jersey City, New Jersey

Today

Easy Apply

Full-time, Contract

Jersey City, New Jersey

3d ago

Easy Apply

Contract

Depends on Experience

Search all similar jobs