Data Engineer

Hybrid in New York, NY, US • Posted 2 hours ago • Updated 2 hours ago

Full Time

Hybrid

$100,000 - $110,000/yr

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Data Engineer
Data Brick
SQL
Delta Lake

Summary

JOB DESCRIPTION:

Title: Data EngineerLocation: Dallas , TX (Hybrid)Employment Type : W2 Only

We are seeking an experienced Data Engineer to design and maintain scalable data pipelines in Databricks. The role involves end-to-end ownership of data workflows, from ingestion to production, ensuring performance, quality, and reliability.

Responsibilities:-Build and optimize pipelines in Databricks (PySpark, SQL, Delta Lake).-Ingest data from databases, APIs, PDFs, Excel, flat files, and web scraping.-Implement data quality checks, validation, and testing frameworks.-Deploy, monitor, and optimize pipelines in Databricks/AWS.-Collaborate with data science/analytics teams and document data processes.

Qualifications:-8+ years of Data Engineering experience.-Hands-on expertise in Databricks (PySpark, SQL, Delta Lake).-Strong experience with structured & unstructured data.-Knowledge of data quality/testing tools (Great Expectations, Deequ, dbt tests).-Proven ability to optimize large-scale Spark/Databricks workloads.

Email : shraddha (dot) m (at) datasysamerica (dot) com

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10314755
Position Id: 8903105
Posted 2 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Hybrid in Jersey City, New Jersey

•

11d ago

Data EngineerIntroduction:This position is for a Data Engineer who will be responsible for building a comprehensive QA framework in Azure DataBricks. The individual will work on gathering, storing, detecting, and processing large volumes of data for QA analysis and bug detection in ETL code. Responsibilities:Develop QA ETL pipelinesEnsure data quality in the QA frameworkOptimize data storage solutions for efficient processingCollaborate with QA analysts to test code and data as part of the SDLC

Easy Apply

Full-time

65 - 75

Data Engineer

Hybrid in New York, New York

•

21d ago

Job Title: Senior Data Engineer Industry: Entertainment & Mass Media Location: New York, NY or Bristol, CT (Hybrid, 3-4 days per week on-site) Duration: 10 months + (Possible conversion to perm) Rate: $93.10/HR Summary: The Product Performance Data Solutions team for the Data organization is in search of a Senior Data Engineer. As a member of the Product Performance team, you will work on building foundational datasets from clickstream and quality of service telemetry data enabling dozens of en

Easy Apply

Contract

90 - 93

Data engineer

Jersey City, New Jersey

•

Today

Design, construct, install, test and maintain data management systems.Ensure systems meet business requirements and industry practices.Build high-performance algorithms, prototypes, predictive models, and proof of concepts.Research opportunities for data acquisition and new uses for existing data.Develop data set processes for data modeling, mining and production.

Easy Apply

Full-time

55 - 60

Data Engineer

Jersey City, New Jersey

•

7d ago

Analytics Solutions Engineer Jersey City, NJ - 308332 Note: Need Local and W2 Candidates only Must: Python programming - very strong SQL Snowflake and/or Streamlit Nice to have: Tableau Databricks Banking products C++, R Spark Job function / requirements: Need good comm skills - ability to translate technical topics to non-tech business. hands on using python to build tools. need real experience in professional environment not working with big data, but it is very complex dat

Easy Apply

Contract

Depends on Experience

Search all similar jobs