Overview
On Site
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
Data Engineer
Agile
Amazon Web Services
Apache Avro
Apache Cassandra
Apache Flink
Apache Hadoop
Apache Parquet
Apache Spark
Apache Storm
Big Data
Data Processing
Data Structure
Databricks
Documentation
Generative Artificial Intelligence (AI)
Data Engineering
Data Lake
Data Modeling
Git
JSON
Java
Jenkins
MongoDB
NoSQL
PostgreSQL
Python
Scala
Terraform
Job Details
Hi,
Greetings!!
My name is Nikhil Gabriel and I am a Staffing Specialist at Donato Technologies, Inc. I am reaching out to you on an exciting job opportunity with one of our clients.
Greetings!!
My name is Nikhil Gabriel and I am a Staffing Specialist at Donato Technologies, Inc. I am reaching out to you on an exciting job opportunity with one of our clients.
Job Title: Sr Data Engineer
Job Location: NYC, NY(Onsite)
Experience: 8+ years
Job Location: NYC, NY(Onsite)
Experience: 8+ years
Need someone local to NY & NJ
Job Description:
- Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java)
- Proficiency in at least one cluster computing framework (preferably Spark, alternatively Flink or Storm)
- Proficiency in at least one cloud data lakehouse platform (preferably AWS data lake services or Databricks, alternatively Hadoop), at least one relational data store (Postgres, Oracle or similar), and at least one NOSQL data store (Cassandra, Dynamo, MongoDB or similar)
- Proficiency in at least one scheduling/orchestration tool (preferably Airflow, alternatively AWS Step Functions or similar)
- Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data
- processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD), and CI/CD tools (Jenkins, Git)
- Strong organizational, problem-solvin,g and critical thinking skills; Strong documentation skills
Preferred skills:
- Experience using AWS Bedrock APIs
- Knowledge of Generative AI concepts (such as RAG, Vector embeddings, Model fine-tuning, Agentic AI)
- Experience in IaC (preferably Terraform, alternatively AWS CloudFormation)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.