diyotta etl with hadoop Jobs

Refine Results
201 - 220 of 283 Jobs

Data Engineer/Big Data Engineer

Atash Enterprises, LLC

•

Columbus, Ohio, USA

Contract

experience with Big Data, Hadoop on Data Warehousing or Data Integration projectsRequired8Years Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata TechnologiesRequired7Years creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), StreamSets pipeline creation, jobs schedulingRequired7Years Writing Hadoop/Hive/Impala scripts for gathering stats on table post data loads.Required7Year
Easy Apply
Posted 22 hours ago

Data Architect- Manager

PricewaterhouseCoopers LLP

•

New York, New York, USA

Full-time

Industry/Sector EUR X-Sector Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infr
Posted 60+ days ago | Updated 7 hours ago

Data Engineer || NYC, NY (100% Remote)

iSquareinfo LLC

•

Remote

Contract

W2 / C2C position Position: Data Engineer Location: NYC, NY (100% Remote) Duration: 12+ Months + Extension Client: Insurance Company Key Skill Sets: Scripting Languages: Python, PySpark ETL Tools: AWS Glue, DBT (or similar) Big Data: Hadoop, EMR Cloud Platforms: AWS (preferred), Azure, Google Cloud Platform Databases: SQL, NoSQL DevOps & CI/CD: Automation, data pipeline deployments Security: Data encryption, compliance standards Others: API building, streaming data platform experience
Posted 1 hour ago

Senior Software Engineer, Data Platform - Experimentation & Evaluation

TikTok

•

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : X9644 Apply to this job Share this listing: Responsibilities Team Introduction Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire experiment life cycle
Posted 60+ days ago | Updated 7 hours ago

Site Reliability Engineer, Data Platform- USDS

TikTok

•

Los Angeles, California, USA

Full-time

Location : Los Angeles Employment Type : Regular Job Code : 262 Apply to this job Share this listing: Responsibilities Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed services and infrastructures. As a site reliability engineer in the data platform area, you will have the opportunity to manage the services and infrastructures in one of the largest data plaforms in the world that directly supports the TikTok a
Posted 60+ days ago | Updated 7 hours ago

Software Engineer

Strategic Staffing Solutions

•

Irving, Texas, USA

Contract

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING! Strategic Staffing Solutions is currently looking for a Software Engineer for a contract opportunity with one of our largest clients located in Irving, TX! Title: Software Engineer Location: Irving, TX (On-Site Required) Duration: 24 Months Role Type: W2 Contract Engagement Pay Rate: $55/HR Job Description: Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale pla
Easy Apply
Posted 25 days ago | Updated 2 hours ago

Big Data/Data Warehouse Engineer Consultant (No 3rd parties)

CXI Staffing

•

Columbus, Ohio, USA

Contract

Big Data/Data Warehouse Engineer ConsultantNo 3rd parties, please. Local candidates only Location: Columbus, OH (Onsite 5 days/week) Schedule: M F, 8:00 AM 5:00 PM EST Interview: Video We are seeking a Technical Specialist to design, develop, migrate, and maintain enterprise data warehouse and Big Data solutions. This role involves building data marts, integrating data from multiple sources, and supporting large-scale analytics initiatives. You will work closely with data governance, analytics
Easy Apply
Posted 16 hours ago | Updated 3 hours ago

TigerGraph Developer

Randstad Digital

•

Jersey City, New Jersey, USA

Contract

job summary: As a TigerGraph Developer, candidate will work with a team to design, implement, and maintain graph database solutions using TigerGraph's graph database platform. Candidate will be responsible for creating and optimizing data models, writing complex GSQL queries, and ensuring the performance and scalability of our graph database solutions. Candidate will play an integral role in developing applications that deliver actionable insights from complex, interconnected data. Candidate sho
Posted 7 days ago | Updated 2 hours ago

Sr. Data Engineer - Full time/W2

Valueprosite

•

Plano, Texas, USA

Full-time

Hi, We're looking for a seasoned Data Engineer with 5 to 8 years of experience to help us architect and optimize data systems that power business insights across departments. You ll design, build, and maintain reliable data pipelines and solutions, enabling teams to wrangle and analyze key metrics effectively. Key ResponsibilitiesBuild and optimize ETL/ELT pipelines (batch and streaming) for high-volume data. Design, implement, and maintain data models and warehouse schemas to support analytics
Easy Apply
Posted 1 day ago

Lead SQL Data Analyst (Property & Casualty )

iBridge Techsoft LLC

•

Remote

Contract, Third Party

Lead SQL Data Analyst - P&C Insurance Remote - USA Role Summary Seeking a seasoned Data Analyst/Technical Lead with 10+ years of experience to support BI and data platform migration initiatives in an onshore role. The ideal candidate will have deep SQL expertise, strong communication skills, and experience leading or coordinating projects across global teams. A background in BI/reporting migration and working closely with business stakeholders is essential. Key Responsibilities Act as onshore l
Easy Apply
Posted 26 days ago | Updated 1 day ago

Sr Data Engineer (DBT, Snowflake)

Critical River, Inc.

•

Pleasanton, California, USA

Full-time

Title: Sr Data Engineer (DBT, Snowflake) Location: Onsite (CriticalRiver Pleasanton, CA office) Duration: Fulltime Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement data solutions, and provide technical expertise throughout the pr
Easy Apply
Posted 13 days ago | Updated 2 hours ago

Data Scientist

Star Software System LLC

•

Malvern, Pennsylvania, USA

Third Party

We are seeking a highly motivated Data Scientist to join our team. You will leverage data to solve complex business problems, build predictive models, and provide actionable insights that drive strategic decision-making. Key Responsibilities: Collect, clean, and preprocess structured and unstructured data from various sources. Develop and implement predictive models, machine learning algorithms, and statistical analyses. Communicate complex analytical findings and business insights to stakehold
Easy Apply
Posted 21 days ago | Updated 1 day ago

Lead Databricks Architect

Nityo Infotech Corporation

•

Jersey City, New Jersey, USA

Contract, Third Party

Role : Lead Databricks Architect Location : Iselin NJ : Hybrid (2-3 Days) Local candidates only Exp level : 15 years+ Must have : Expert in Databricks , Pyspark , python, SQL JD: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and proficiency in pyspark. Cloud platform: Preferred Azure
Easy Apply
Posted 25 days ago | Updated 19 days ago

Snowflake & Big Data Migration Consultant (No 3rd parties)

CXI Staffing

•

Columbus, Ohio, USA

Contract

Technical Specialist 4 Consultant Snowflake & Big Data Migration hybrid role in Columbus, OH, on site 5 days per week. We strongly prefer local candidates. Third parties - please, do not contact us directly by phone or email. We are seeking a Technical Specialist 4 to lead migration and operations for the ODM Enterprise Data Warehouse (EDW), moving production data (weekly, monthly, yearly) from a Hadoop-based Big Data platform to Snowflake. This role involves building and optimizing ELT pipeline
Easy Apply
Posted 16 hours ago | Updated 3 hours ago

Data Engineer

Dexian DISYS

•

Smithfield, Rhode Island, USA

Contract

Data Engineer Smithfield, RI or Merrimack, NH or Westlake, TX Onsite Hybrid Experience: Solid experience with Oracle databases and Snowflake data warehousing. Proficiency in Unix and shell scripting. Hands-on experience with AWS Data Engineering services including AWS Batch, S3, EMR, EC2 Expertise in Informatica for data integration and ETL processes. Solid understanding of data modeling and data architecture principles. Strong SQL skills for data querying and manipulation. Familiarity with CI
Easy Apply
Posted 7 days ago | Updated moments ago

Sr Data Engineer (Dbt, FiveTran,)

Critical River, Inc.

•

Pleasanton, California, USA

Full-time

Title: Sr Data Engineer (dbt, FiveTran, SQL,Google Cloud Platform) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement data solutio
Easy Apply
Posted 47 days ago | Updated 2 hours ago

Data Modeler

Newt Global

•

Irving, Texas, USA

Contract

Key Responsibilities: Design and develop conceptual, logical, and physical data models to support transactional, analytical, and reporting systems.Partner with business stakeholders and SMEs in banking and wealth management to gather and analyse requirements.Translate business needs into high-quality data models for investment products, client portfolios, financial planning, advisory services, and regulatory reporting.Develop and maintain data dictionaries, metadata repositories, and data lineag
Easy Apply
Posted 23 days ago | Updated 7 days ago

SAS Administrator with P&C Insurance experience

SANS

•

New York, New York, USA

Third Party, Contract

Title: SAS Administrator Location: Hybrid (Wednesday in NYC) Duration12+ Months Job Summary: We are seeking a skilled and experienced SASAdministrator to manage, support, and optimize our SAS environment. The ideal candidate will be responsible for ensuring the performance, security, and reliability of SAS software platforms and will work closely with business analysts, developers, and IT infrastructure teams to support enterprise reporting and data analytics needs. Key Responsibilities: Inst
Easy Apply
Posted 11 days ago | Updated 1 day ago

Senior Azure Cloud Data Engineer-Locals

Intellisoft Technologies

•

Philadelphia, Pennsylvania, USA

Contract

Hi, Please go through the JD, Position: Senior Azure Cloud Data Engineer Location: Philadelphia, PA Duration: 6 months contract to Hire Client is seeking an experience Azure Cloud Data Engineer. The Senior Azure Cloud Engineer will be responsible for designing, deploying, and maintaining our Azure Data pipelines. You will develop, optimize, and maintain data pipelines as well as support data platform team's efforts to generate data-driven insights. The Senior Azure Data Engineer is a member of
Easy Apply
Posted 5 days ago

Sr.DataEngineerWith strongGoogle Cloud PlatformBackground (12+ yrs minimum experience required)

Aroha Technologies

•

Philadelphia, Pennsylvania, USA

Third Party, Contract

Title: Sr. Data Engineer With strong Google Cloud Platform Background Experience: 12+ Years Location: Onsite- From Philadelphia PA (Need only Locals to PA) Candidate has to be from PA Primary Skills- PySpark, Spark, Python, Big Data, Google Cloud Platform, Apache Beam, Dataflow, Airflow, Kafka and BigQuery Good to Have: GFO, Google Analytics Javascript is Must Job Description: 12+ years experience as a data warehouse engineer/architect designing and deploying data systems in a sta
Easy Apply
Posted 2 hours ago | Updated 2 hours ago