IceBerg Data Engineer - 100% REMOTE - NJTECH INC. - Remote | Dice.com

NJTECH INC.

Apply Now

IceBerg Data Engineer - 100% REMOTE

Remote • Posted 1 day ago • Updated 1 day ago

Contract Independent

Contract W2

No Travel Required

Remote

Depends on Experience

Apply Now

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

Iceberg
Python
PyIceberg
Pyarrow
DuckDB
AWS

Summary

Job Title: Data Engineer – Python & Iceberg Specialist

Location: Remote
Contract Type: Longterm

About the Role

We are seeking a Data Engineer with strong Python expertise and experience working with modern data lake technologies to join our team. This role will focus on building efficient data workflows and integrating large-scale datasets into web applications. You will work closely with backend engineers to design and optimize data access layers for a client leveraging Apache Iceberg and Python-based tools.

Key Responsibilities

Design and implement data access layers for web applications using Iceberg.
Develop efficient querying workflows using Pandas, PyArrow, and DuckDB.
Optimize memory-heavy operations and improve performance for large datasets.
Build and maintain ETL pipelines for batch updates and overwrite workflows.
Manage Iceberg table metadata, schema evolution, and partitioning strategies.
Collaborate with backend engineers to integrate data services into RESTful APIs.
Implement caching and pre-processing strategies to reduce latency.
Ensure data integrity and consistency across snapshots and versions.

Required Skills & Experience

Strong Python programming skills with experience in data engineering.
Hands-on experience with PyIceberg or similar technologies (Delta Lake, Hive).
Proficiency in Pandas, PyArrow, and DuckDB for data manipulation.
Understanding of data lake architectures, Parquet format, and columnar storage.
Experience with ETL design, batch processing, and overwrite workflows.
Familiarity with cloud storage systems (e.g., AWS S3, Azure Data Lake Storage).
Knowledge of query optimization and performance tuning for large datasets.

Preferred Qualifications

Experience integrating data workflows with FastAPI, Flask, or similar frameworks.
Background in data governance, metadata management, and schema evolution.
Exposure to distributed systems and big data processing frameworks (Spark, Flink) is a plus.

Soft Skills

Strong problem-solving and analytical skills.
Ability to work collaboratively with cross-functional teams.
Adaptability to evolving technologies and project requirements.

Why Join Us?

Work on cutting-edge data lake technologies.
Collaborate with a dynamic team building scalable web applications.
Opportunity to influence architecture and performance optimizations.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91092521
Position Id: 8807190
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Remote

•

Today

Overview: Our client, a Global Fortune 50 organization and one of the world s largest distributors of healthcare systems, medical supplies & pharmaceutical products, seeks an accomplished Oncology Data Integration Engineer. Candidate must be authorized to work in USA without requiring sponsorship Location: Irving, TX 75039 (100% Remote acceptable) Duration: 5 months contract w/ possibility of extension or conversion to FTE role Job Description: Seeking highly skilled contractor(s) to support

Easy Apply

Contract

$50 - $60

Data Engineer (Only W2 with 10 years) - 100% Remote

Remote

•

22d ago

Role: Data EngineerLocation: Remote Job Description: Summary:The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization s data assets. Qualification Ability to interact with business partners, engineering, and data science to translate ambitious marketing goals to data deliverab

Easy Apply

Contract

Depends on Experience

Data Engineer / Platform Specialist on Google Cloud Platform 100% REMOTE

Remote

•

3d ago

Data Engineer or Platform Specialist on Google Cloud Platform @ REMOTE Data Engineer or Platform Specialist on Google Cloud Platform Location: 100% REMOTE Duration 6 months (Contract to Hire) Expertise in Google Cloud Platform (Google Cloud Platform) architecture and services with a focus on streamlined end-to-end analytics pipelines and governance[SS: Familiarity with Google Cloud Platform data services including Data Flow, Data Prep, Data Form, Dataplex, Vertex AI, Cloud Composer etc - most

Easy Apply

Contract

Depends on Experience

DATA INTEGRATION ARCHITECT - 100% remote

Remote or Rockville, Maryland

•

Today

Job Title: Data Integration Architect (Data Integration & Modernization) Location: 100% remote Type: Contract - long term Pay Rate - W-2 or C2C, negotiable Overview: A local government client is advancing the next phase of its Housing Portal initiative, a multi-program effort to enhance data integration, streamline business processes, and improve transparency across housing and community services. The Solution Architect (Data Integration & Modernization) will serve as a key technical strategis

Easy Apply

Contract

IceBerg Data Engineer - 100% REMOTE

Dice Job Match Score™

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs

Dice Job Match Score™

Shan Mukthar