hdfs jobs

Lead/Principal Data Engineer/ Architect (HDFS, S3, Spark, Kafka)

Charlotte, North Carolina

•

Today

Trigyn has an immediate opening for Lead/Principal Data Engineer in Charlotte, NC (Remote). The particulars of the opportunity are below: Description: ? Must be able to architect new systems from scratch. experience in modern cloud Data technologies, including Spark, Spark Streaming, Confluent Kafka, Git, Databricks, CICD, SQL, and ETL tools such as Data Stage. ? Possess experience in Python and Spark for automation, data transformation, reporting, data manipulation, and data cleaning. Require

Third Party, Contract

DOE

SCALA Developer

Remote

•

Today

Role: SCALA Developer Location: Remote - Anywhere in USA Required Skills: Apache Spark with Scala is Must Drools experience is requiredMust have experience in Hadoop Distributed File System (HDFS) SQL experience is needed in Advanced levelJava Enterprise Edition (Java EE / J2EE) experience.

Easy Apply

Full-time

$100,000 - $120,000

Distributed Systems Engineer **100% REMOTE**

Remote

•

Yesterday

Do something big and innovative! Stretch your creative muscles and work on big issues. Since 1989, we have developed technology environments, applications, and tools by providing experienced teams to implement, enhance, and maintain our clients essential systems and applications. Come join the Scalence team! Title: Distributed Systems Engineer (migration focused) Start Date: ASAP Duration: 12 months Location: Fully remote (Pacific work hours) Pay Rate: $60/hr. Job Summary We are looking for a

Easy Apply

Contract

Up to $60

Fulltime Data Engineer

Cleveland, Ohio

•

7d ago

Fulltime Data Engineer Location : Cleveland, OH Required Skills & Qualifications Bachelor s or Master s degree in Computer Science, Data Engineering, Information Systems, or a related field.3 6 years of professional experience in data engineering or big data development.Strong programming skills in Python (experience with data libraries such as pandas or PySpark).Proven experience with PySpark for distributed data processing.Solid understanding of Hadoop ecosystem tools (HDFS, Hive, MapReduce, O

Easy Apply

Full-time

$100,000 - $120,000

Hadoop Developer

Chicago, Illinois

•

3d ago

Position: Apache Hadoop Developer Location: Richardson/Chicago (Hybrid) Duration: Long term Contract Visa: Mandatory skills: Apache, hadoop, Apache Hadoop, HDFS, YRAN, MapReduce, Spark, Hive, Hbase, Phoenix, Pyspark & SQL on Hadoop either admin profiles on above architect Job Description: Having programming language on pyspark, Spark, SQL, Shell scripting Apache, hadoop,Apache Hadoop, HDFS, YRAN, MapReduce, Spark, Hive, Hbase,Phoenix,Pyspark & SQL on Hadoop either admin profiles on above archit

Easy Apply

Contract, Third Party

Depends on Experience

Cloudera Data Engineer-65050

Remote

•

10d ago

Position:- Cloudera Data EngineerLocation:- 100% RemoteClient: STATE OF NE Job code: 65050 Job Description: Client Info : Nebraska Department of Health and Human Services Cloudera Data EngineerJob Summary We are seeking a Cloudera Data Engineer to support the migration of a Medicaid Data Warehouse Implementation in AWS environment. The resource will support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another. T

Easy Apply

Full-time

Depends on Experience

(Need Local to Georgia) Data Engineer

Hybrid in Atlanta, Georgia

•

Yesterday

Role: Sr. Data Engineer Location: Alpharetta, GA (Hybrid) Duration: 12+ Months Must have: JavaPythonApache Spark Requirements: Hands-on experience in building and optimizing data processing applications using Java and Python, ensuring high performance and scalability of data pipelines.Advanced knowledge of Apache Spark to handle large-scale data processing tasks, including the development and optimization of complex Spark applications for efficient data transformation.Comprehensive understandi

Easy Apply

Third Party, Contract

Depends on Experience

PySpark Developer & Big Data Engineer

Hybrid

•

10d ago

Job Title: PySpark Developer & Big Data Engineer About the Role We are seeking a skilled PySpark Developer & Big Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions using Apache Spark, Python, and related Big Data technologies. Youll work closely with data architects, analysts, and business stakeholders to build robust data pipelines that support analytics, reporting, and machine

Easy Apply

Contract

Depends on Experience

Big Data Java Spark Developer

Jersey City, New Jersey

•

Today

Grow your career an innovative global bank in Jersey City, NJ as a Big Data Developer with strong Java, Hadoop, Scala, Spark expeirence. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their know

Easy Apply

Full-time

0/hr - 0/hr

Senior Data Engineer

Hybrid in Pittsburgh, Pennsylvania

•

15d ago

<>Job Title: Data Engineer Pipeline Focus (Contract-to-Hire)Location: Hybrid / Remote - Pittsburgh, PA / Dallas, TX / Cleveland, OHIndustry: Financial ServicesType: Contract to Hire (3-6 Months) Sponsorship: Not AvailableJoin a fast-growing data engineering team at a leading financial institution undergoing a major data modernization initiative. Were looking for hands-on Data Engineers with strong pipeline and data operations experience to support scalable, secure, and analytics-ready data plat

Easy Apply

Contract

110000 - 130000

Senior Machine Learning Engineer - Ranking and Recommendations

Sunnyvale, California

•

Today

About the Role The Shopping Ranking Team mission is enabling eaters to effortlessly make shopping decisions and find what they need. We pursue this mission via an ML-driven algorithmic approach, applying state-of-the-art Machine Learning (ML), Optimization techniques to learn from massive datasets Uber has, and build a scalable and reliable shopping intelligence ranking and recommendation systems. We are actively seeking a Senior Machine Learning Engineer who excels in problem-solving and crit

Full-time

USD 198,000.00 - 220,000.00 per year

Data Engineer

Tysons, Virginia

•

Today

Job Description Base-2 Solutions is seeking a Data Engineer who will work with team members to build, deploy, and operate data pipelines and data engineering components to enable data brokering and exchange capabilities across a diverse range of producers and consumers. Responsible for building robust, scalable data pipelines while working collaboratively with cross-functional teams to ensure seamless integration, optimized performance, and efficient delivery of solutions. Capabilities Work wi

Full-time

Backend .Net Developer

Hybrid in California

•

Today

Title : Backend .Net Developer with SSIS Location: Rancho Cucamonga,CA (Hybrid) Experience At least five (5) years of experience designing, developing, and maintaining complex SQL Server databases and ETL solutions using SSIS (SQL Server Integration Services). Candidates must possess solid work experience in data integration, performance tuning, and enterprise-level data workflows. Skill/Knowledge: Client-Side Developer Requirements: Ability to utilize rest and soap webservices Server-Side Dev

Easy Apply

Contract

BASED ON EXPERIENCE

Google Cloud Platform Data Engineer

Remote

•

Today

Position: Google Cloud Platform Data Engineer Location: Open (Remote or Onsite Options) Duration: 12 Months Overview: We are seeking a highly skilled Google Cloud Platform Data Engineer to design, develop, and optimize large-scale data pipelines and analytics solutions on Google Cloud Platform. The ideal candidate has hands-on experience with Python, Apache Spark, BigQuery, and related Google Cloud Platform services, with a passion for building scalable data architectures that drive business ins

Easy Apply

Third Party, Contract

$50 - $60

Software Engineer (TS/SCI)

Springfield, Virginia

•

Today

Vantor is forging the new frontier of spatial intelligence, helping decision makers and operators navigate what's happening now and shape what's coming next. Vantor is a place for problem solvers, changemakers, and go-getters-where people are working together to help our customers see the world differently, and in doing so, be seen differently. Come be part of a mission, not just a job, where you can: Shape your own future, build the next big thing, and change the world. To be eligible for this

Full-time

USD 90,000.00 - 188,000.00 per year

Data Engineer

Hybrid

•

15d ago

Data Analyst (Contract to Hire)Introduction:Join a growing data organization at the forefront of innovation in financial services. We are seeking talented data engineers at one of our cusomters to help modernize and scale data capabilities across multiple lines of business, including commercial, retail, and wealth. You will work on high-impact projects that span both on-prem and cloud environments, supporting next-generation data pipelines, governance, and analytics. If you are passionate about

Easy Apply

Full-time

100,000 - 130,000

Hadoop Platform Engineer

Remote or Hybrid

•

Today

At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this role. We thank you for your understanding. Overview: Role is specifically a Hadoop Platform Engineer. Engineer will have deep, hands-on experience across the Apache Hadoop ecosystem, focused on building and maintaining a reliable, scalable data platform; strong core Hadoop and Java expertise, enabling them to diagnose, optimize, and tune performance at the cluster and infra

Easy Apply

Contract

$80-$100 per hour

Data Engineer

No location provided

•

Today

Type: Contract Job #3847 Data Engineer Tysons Corner, VA Active TS/SCI with Polygraph Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our most prized assets are our employees, we continually focus our attention on improving the overall work/life experience they have supporting the mission. Our Team is pushed every day to use their industry leading knowledge to provide end-to-en

Full-time

ETL Developer

Remote or Tampa, Florida

•

Today

The ETL Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and est

Full-time

USD 96,960.00 - 145,440.00 per year

Lead Software Engineer (Data)-0985

Remote or Reston, Virginia

•

Today

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Job Description DUTIES: Provide technical leadership within teams responsible for perfo

Full-time

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization