Data Engineer || Only local to New York, NY (Onsite Role)

New York, NY, US • Posted 1 day ago • Updated 1 day ago
Full Time
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Apache Kafka
  • Apache Spark
  • Dashboard
  • Extract, Transform, Load
  • Firewall
  • Grafana
  • Linux
  • JSON
  • Messaging
  • Machine Learning (ML)
  • Python
  • Redis
  • RabbitMQ
  • Dragon NaturallySpeaking
  • Network
  • Pandas
  • Routing
  • Shell
  • Routers

Summary

Responsibilities:

·            Write efficient, legible, and concise Python and SQL code.
·            Troubleshoot operational, system, and code issues.
·            Will work within the Scrum Framework and Agile methodologies.

Qualifications:

Candidates must have a at least a bachelor’s degree in computer science.  A master’s degree is a plus.
Candidates should have 2 – 4 years of experience in system operations, development, or programming role.
Candidates must demonstrate a proficiency in Linux.
Candidates must demonstrate a proficiency in writing Python, SQL, and shell code.
Candidates would ideally have knowledge of Python data libraries such as Pandas, DuckDb, Polars, etc. (extra points for ML libraries)
Candidates must demonstrate a proficiency in SQL, knowledge of other database systems such as Mongo, Elastic, Redis, etc. is beneficial but not required.
Candidates must have an understanding of networking components (e.g. routers, firewalls, switches, balancers), network functions (switching, routing, forwarding, etc.), and the OSI model layers.
Candidate must demonstrate understanding of APIs, functions and implementations, e.g. REST/SOAP APIs.
Candidates should have an understanding of various data formats and containers, e.g. JSON, Parquet, CSV
Candidates should have an understanding of ETL pipelines.
Experience with administration of Grafana and creating dashboards within Grafana is a plus
Knowledge of network, transport, and other protocols (i.e. UDP/TCP/HTTP/TLS/DNS/LDAP) is a plus.
An understanding of distributed systems such as Spark or Dask is a plus.
Experience in messaging/pipeline tools (i.e. Kafka, RabbitMQ ) is a plus.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91140717
  • Position Id: 9003566
  • Posted 1 day ago
Contact the job poster
Ashish Joshi

Ashish Joshi

Recruiter @ AKAASA Technologies
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or New York, New York

Today

Contract

$65 - $65 hourly

Remote or New York, New York

Today

Contract

$65 - $65 hourly

Remote or New York, New York

3d ago

Full-time

USD 120,000.00 - 160,000.00 per year

New York, New York

Today

Full-time

USD 90,000.00 - 110,000.00 per year

Search all similar jobs