hadoop administrator with apache spark Jobs

Refine Results
21 - 40 of 725 Jobs

Software Engineer Intern (Big Data - Data Platform) - 2025 Summer/Fall (MS)

TikTok

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Intern Job Code : A186506 Apply to this job Share this listing: Responsibilities As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of

Data Engineer experienced in RETAIL

Emonics LLC

Sunnyvale, California, USA

Contract

Key Responsibilities:Design and develop scalable data pipelines for large-scale processing and transformation. Integrate structured and unstructured data sources from various systems. Build, manage, and optimize data architectures to support business intelligence and analytics. Develop frameworks for data transformation, metadata management, dependencies, and workload orchestration. Collaborate with analysts, data scientists, and product teams to deliver timely and accurate data solutions. Requi

Data Engineer

TechNix LLC

Pittsburgh, Pennsylvania, USA

Contract

Position: Data Engineer Duration: Full Time Location Pittsburgh, PA and Cleveland, OH Job Description: 8+ Years' experience working in Data Analysis . Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,Spark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce). Hands on experience with Python & Kafka . Good understanding of Database concepts , Data Design , Data Modeling and ETL. Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing , D

SAS Teradata Developer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

A client of Innova Solutions is immediately hiring for a SAS Teradata Developer Position: SAS Teradata Developer Position Type: W2-Contract Locations: Charlotte, NC and Plano, TX Hybrid: 3 days Onsite and 2 days remote The ideal candidate will have: SAS, Teradata, Python,SQL and Hadoop Required Qualifications 7+ years of software development experienceStrong experience in complex SQL query, PL/SQL programming,Strong software design, build, test and documentation skills * Proven track record in p

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Hadoop/ETL Developer - Production Support

Innova Solutions, Inc

Plano, Texas, USA

Contract

A client of Innova Solutions is immediately hiring for a < Hadoop/ETL Developer - Production Support> Position type: Full-time - Contract Duration: 12+ Months Location: Plano, TX As a Hadoop & ETL Developer to support production (L3) in Treasury ADS, individual will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical problems arise during the real time in production. Indivi

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

BigData Developer

Innova Solutions, Inc

Addison, Texas, USA

Contract

A client of Innova Solutions is looking for Bigdata Engineer. Position type: Contract Duration: Long Term Location: Addison, TX/Charlotte, NC/Chicago, IL (Hybrid 3 Days Onsite) As a Bigdata Engineer, you will: Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with Ha

Druid Engineer

Biztec Global LLC

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in

Data Engineer

MARKS IT SOLUTIONS LLC

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CA (Onsite)Need local to CA candidatesClient: WalmartW2 roleResponsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancem

Data Engineer - Spark

Exl Service

Remote or Fremont, California, USA

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract

AI/ML Data Scientist

Miracle Software Systems, Inc.

Dearborn, Michigan, USA

Contract

Miracle Software Systems, Inc. is currently seeking a qualified AI/ML Data Scientist for their Dearborn, Michigan location. Kindly review the attached job description and share your updated resume if you are interested in exploring this opportunity. Requirement Details: Job Title: AI/ML Data Scientist Location: Dearborn, Michigan. Duration: Full-time Skills Required: "Programming: Python, Java, R, SQL Machine Learning/AI: TensorFlow, PyTorch, Keras Data Analysis & Manipulation: Pandas, NumPy, dp

Snowflake developer

iPeople Infosystems LLC

Remote

Full-time

Role: Snowflake developer Location: Remote Type: Fulltime Job description This position is responsible for development/support of Enterprise data processing systems through enhancement of related software and processes. Develops software and procedures that improve processing capabilities. Analyzes, codes, tests, and implements in coordination with management, associates, and end users. Serves as production system support by resolving issues and ensuring ongoing functionality. May oversee th

Java Developer with Angular

Knight InfoTech LLC

Charlotte, North Carolina, USA

Contract

Location North Carolina (Hybrid) 7+ years of experience in Java.Strong experience with Java (Spring, Hibernate, etc.) in building scalable backend services, APIs, and microservices.Extensive experience with SQL, including query optimization, database design, and management of relational databases.Proficiency in Test-Driven DevelopmentExperience working in Agile development environments and collaborating with cross-functional teams.A fast learner of new technologies.Excellent problem-solving skil

Big data Developer

LTIMindtree

Tampa, Florida, USA

Full-time

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 9

Data Scientist/Architect-Principal

IKCON TECHNOLOGIES Inc.

Mason, Ohio, USA

Contract

IKCON TECHNOLOGIES INC delivers exceptional IT services and solutions that provide clients with definite edge over competitors and promoting highest standards of quality. We are currently looking for a Data Scientist/Architect-Principal with one of our clients in Mason, OH. If you are actively looking for opportunities, please send us your updated resume with your contact details. "U.S. Citizens and those authorized to work in the U.S. are encouraged to apply." JOB TITLE Data Scientist/Architec

Data Engineering Manager - Security

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Securing our members' data and accounts appropriately is key to maintaining a high level of trust with our customers. In addition, securing our technology infrastructur

Data Engineering Manager - Member Innovation

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We are looking for an experienced leader to help lead the Member Innovation Data Engineering team. This team will work in close partnership with Data Scientists and Pro

Java developer

Knight InfoTech LLC

Texas City, Texas, USA

Contract

Location NC, NY, TX 7+ years of experience in Java. Strong experience with Java (Spring, Hibernate, etc.) in building scalable backend services, APIs, and microservices. Extensive experience with SQL, including query optimization, database design, and management of relational databases. Proficiency in Test-Driven Development Experience working in Agile development environments and collaborating with cross-functional teams. A fast learner of new technologies. Excellent problem-solving skills and

Data Engineer

Eliassen Group

Anywhere, US

Contract

Description: We're looking for two skilled Senior Data Engineers to join a high-impact project migrating workloads from a Hadoop On-Prem cluster to Google Cloud Platform (Google Cloud Platform). We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $65 - $75 / hr. w2 Responsibilities: Build Spark/BigQuery data pipelines on Google Clo