Hadoop Developer/Spark Engineer Jobs in Sterling, VA

Refine Results
1 - 20 of 686 Jobs

ETL / Spark Developer

PETADATA

On-site in McLean, Virginia, USA

Full-time

POSITION: ETL / Spark Developer LOCATION: McLean, VA. (Hybrid) Experience: 10+ years Work type: Fulltime (W2 / C2C) PETADATA is currently looking to hire for the ETL / Spark Developer role for one of their clients. Roles & Responsibilities: Should have experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients. Collaborate with cross-functional teams to understand data requirements and design robust data

Lead Software Engineer Backend (Python, SQL, ETL, Spark, AWS)

Capital One

On-site in McLean, Virginia, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Lead Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software Eng

ETL Developer with IICS, python/Py spark - Mclean,VA - Locals or nearby - Hybrid

Cyber Sphere LLC

Hybrid in McLean, Virginia, USA

Contract, Third Party

Job title: ETL Developer with IICS, python/Py spark Location: McLean, VA - Hybrid Longterm Need mandatory: ETL : yrs exp IICS : yrs exp SQL : yrs exp Python / Pysprak : yrs Shell scripting : yrs AWS : yrs Role Description This is a contract role for an ETL Developer with IICS, python/PySpark experience at Cyber Sphere. The ETL Developer will be responsible for the day-to-day tasks of extracting, transforming, and loading data. This is a hybrid role based in McLean, VA, with flexibility for so

Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS)

Capital One

On-site in McLean, Virginia, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software E

Lead Software Engineer Backend (Python, SQL, ETL, Spark, AWS)

Capital One

On-site in McLean, Virginia, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Lead Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software Eng

Senior Data Engineer (Python, Scala, or Spark)

Capital One

On-site in McLean, Virginia, USA

Full-time

West Creek 3 (12073), United States of America, Richmond, Virginia Senior Data Engineer (Python, Scala, or Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about

Spark/Big Data Engineer

The Depository Trust & Clearing Corporation

Hybrid in McLean, Virginia, USA

Full-time

Job Tittle: Spark/Big Data Engineer Duration: Full-time Location: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote) Must Have: Spark Your Primary Responsibilities: Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build data and analytics tools that utilize the data pipeline to provide actionable insigh

Spark/Big Data Developer

The Depository Trust & Clearing Corporation

On-site in McLean, Virginia, USA

Full-time

Short Description for Internal Candidates The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform. Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment Description for Internal Candidates Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive inv

Spark Developer with ETL/PySpark

ApTask

Hybrid in McLean, Virginia, USA

Contract

Position Title: Spark Developer with ETL/PySpark Job Location: McLean, VA (Hybrid) Job Type: Contract (C2C or W2) / FTE JOB DESCRIPTION: Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clientsCollaborate with cross-functional teams to understand data requirements and design robust data architecture solutionsImplement ETL proces

OpenText Developer/Senior Engineer - G

Next Step Systems

On-site in Arlington, Virginia, USA

Full-time

OpenText Developer/Senior Engineer, Arlington, VA We are seeking an OpenText Developer/Senior Engineer to design, modify, develop, write, and implement software programming applications. You will support and/or install software applications/operating systems. You will also participate in the testing process through test review and analysis. OpenText Developer/Senior Engineer Responsibilities: - Provide OpenText development related support and services for clients. This could include full soft

Cloudera Hadoop Engineer

Provish Consulting

Hybrid in Washington, District of Columbia, USA

Full-time

Role: Cloudera Hadoop Engineer Location : Washington, DC Type : Contract / Full Time - HYBRID Job Description - Client is looking for a Big Data Engineer to join the Advanced Data and Analytics Capabilities Team. Hands-on/advanced (expert preferred) level experience in administrating and engineering relational databases (ex. MySQL, PostgreSQL), Big Data systems (ex. Cloudera Data Platform Private Cloud and Public Cloud), Apache Solr as SME, ETL (ex. Ab Initio), BI (ex. MicroStrategy), automation

Hadoop Administrator/Developer

R Systems, Inc.

Remote

Contract

Position: Hadoop Administrator/Developer Location: Remote Duration: 6 Months Requirement: Hadoop Administrator/Developer who is currently managing Hadoop in a Linux environment. Linux is very important. Shell scripting Recent Hortonworks experience Exposure to a data migration project from on-prem to Azure Hive, Spark, Flume, HBase, Oozie

Hadoop Developer

Purple Drive Technologies LLC

Remote

Contract, Third Party

6 + yrs of relevant experience Hadoop, Spark, Scala, MapR

100% REMOTE : PLATFORM DATA ENGINEER - Python, Pyspark, Google Cloud Platform, SQL Tunning, Data Proc, Spark Configure- Minimum 14+ Years - C2C is fine-CH

Empower Professionals

Remote

Third Party, Contract

Hi, I hope everything is fine , Please check the following JD and let me know if you re interested Role: Platform Data Engineer Location: Remote (CST Time) Duration: 12+ Months 14+ Years experience Must have: Data ProcAirflowPySparkSpark configurationPythonSQL tuningGoogle Cloud PlatformData Pipelining Requirements: For this role the engineers with responsibilities to help the platform users.The users are data analysts and data scientists. So we are a data engineering and a platform support t

Python/Spark/ETL Application Developer - AWS

My IT LLC

Remote

Full-time, Contract

Role: Python/Spark/ETL Application Developer - AWS Location: Richmond, VA (Remote) Contract: 6+ Months possible to extend Job Responsibilities: Able to do analysis of complex business requirements for developers Able to provide expertise and leadership for analysis, design, and modeling tasks Delivery-focused and hands-on Quality-focused Able to design, develop, implement, test, deploy, and support server-less infrastructure in AWS Cloud Able to ensure security and compliance requirements are

Java Back End Developer (Must Have Spark & Data Pipelines Experience)

Apolis

Remote

Contract

Role: Java Back End Developer (Must Have Spark & Data Pipelines Experience) Location: Remote Canada or US Duration: 6-12+ Months Note: Only W2, No C2C (We are looking for candidates with BIG TECH experience) Must Have: 5+ years experience with Java / PythonFamiliarity with technologies such as Spark, Airflow, and Presto (spark is a must have)Familiarity with technologies such as Docker, Airflow, Kubernetes, Terraform, and moreFamiliarity with AWSExperience with a variety of data technologies

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Software Engineer

Agilebeat, Inc.

On-site in Springfield, Virginia, USA

Full-time

Agilebeat, Inc. is currently looking to hire a Software Engineer on a full time, permanent basis. This opportunity must be performed onsite in Arlington, VA and requires an active Top Secret clearance (minimum). Active TS/SCI or TS/SCI w/ CI Polygraph clearance highly desired. Agilebeat, Inc. is offering a SIGN ON BONUS and a competitive benefits package for this position. Title: Software Engineer Location: Springfield, VA Summary: As a software engineer, you know that good software is more th

Profile Developer/MUMPS Engineer.

Pyramid Consulting, Inc.

Remote

Contract

Immediate need for a talentedProfile Developer/MUMPS Engineer. This is a12+ Months contract opportunity with long-term potential andis located in U.S(Remote).Please review the job description below and contact me ASAP ifyou are interested. Job ID: 24-09450 Pay Range: $70- $80/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Work with the Development Team Leader

Software Developer - Machine Learning

BayOne Solutions

Remote

Contract

Title: Software Developer - Machine Learning Contract: 12+ Months Location: Remote Pay Rate $75/Hr on W2 Mid-level / Exp Needed 3-5 years of experience. (No C2C or Third-Party Vendors) Description: Ability to write robust code in one or more of Python, Go, and Java Proficient in core technologies like Spark, Hadoop and Hive. Experience in building real-time applications, preferably in Spark and streaming platforms like Kafka and Kinesis. Good understanding of machine learning pipelines and ma