Apache Spark jobs in Virginia

Chantilly, Virginia

•

Today

Job Number: R0245365 Spark Data Engineer, Senior The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their big data to impact important missions-from fra

Full-time

USD 77,600.00 - 176,000.00 per year

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Watsonx.data Consultant with Spark and scala experience

Remote

•

Today

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Contract, Third Party

Depends on Experience

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Big Data Engineer – Python/Scala, Spark, Hadoop

Arlington, Virginia

•

3d ago

Role: Big Data Engineer Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Exp Level : 6 to 12 Year Position : 2 Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality High proficiency in using Python or Scala, Spark, Hadoop platforms & tools

Easy Apply

Full-time, Third Party

$120000 - $135000

Senior Data Software Engineer, Spark, Java, Scala

Remote

•

Today

We are seeking a Senior Software Data Engineer to join our team in a software engineering capacity. This is not a data-science or analytics position centered on ad-hoc data exploration; instead, the role focuses on building software, data processing jobs, and data pipelines consumed by internal and external partners. Data is our main product and first-class citizen, and we value correct, high-quality data as much as clean and maintainable code. Responsibilities Write new data pipelines and jobs

Full-time

Remote: Databricks Lead

Remote or Hybrid in Dallas, Texas

•

4d ago

Total 15+ years of exp. Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software designs, test results and technical manuals using AWS.Confer with business units and development staff to understand both the business and technical requirements for producing technical

Easy Apply

Contract

Depends on Experience

Senior Data Engineer - Spark & AWS

Remote or Greenwood Village, Colorado

•

Today

RESPONSIBILITIES: Kforce has a client in the telecommunications industry that is seeking an experienced Senior Data Engineer in Greenwood Village, CO to join a high-impact engineering team developing enterprise-scale data solutions. This role offers the opportunity to work on modern cloud technologies, large-scale data processing, and AI-driven analytics that support mission-critical business initiatives. If you enjoy solving complex data challenges, building scalable data pipelines, and working

Contract

$65 - $75 hourly

Spark or Java Developer

Springfield, Virginia

•

Today

Absolute Business Solutions Corp (ABSC) is not just another tech company. We're a community of innovators, engineers, analysts and business professionals working together with our customers to tackle the most complex challenges. For more than 20 years we've supported critical DoD, IC and Federal Civilian missions and global, multi-national corporations. We specialize in supporting our clients in the Intelligence, Technology, Defense, AI/ML, and Data Science fields. As we continue to grow at a ra

Full-time

USD 150,000.00 - 275,000.00 per year

Spark or Java Developer

Herndon, Virginia

•

Today

Full-time

USD 150,000.00 - 275,000.00 per year

Sr. Software Engineer

Remote

•

19d ago

Role: Sr. Software Engineer position Location: Mexico or Costa Rica(Remote) Key Responsibilities Develop highperformance bigdata applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python.Build and optimize cloudnative data pipelines on Azure, including ADFbased ingestion, transformation, and orchestration.build and maintain fullstack applications using modern JavaScript frameworks (React, Angular, or Vue) and backend services (Node.js, Python, or Java).Implement robust APIs a

Easy Apply

Contract

Depends on Experience

Senior Databricks Solution Architect

Remote

•

6d ago

Senior Databricks Solution Architect 100% RemoteLong Term Contract Overview: We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and deliver

Easy Apply

Third Party, Contract

$70 - $80

Data Engineer

Remote

•

9d ago

Job Title: Senior Data Engineer Experience:10+ Years Title: Data Engineer Location: Remote Need Data Engineers with: 1. Hands on experience working in Databricks understanding the core engineering capabilities of the tool (data organization, engineering techniques, compute). 2. Strong understanding of data i.e. ability to read tables and come up with the right join criteria, run data checks like duplicate identification, etc. 3. Very strong communication skills. We are moving very fast, many m

Easy Apply

Contract

Senior Data Science Analyst

Hybrid in Richmond, Virginia

•

18d ago

Job Description: Description: Pre-Screen Questions: (Please list at the bottom of candidate resume) 1. What does production-ready pipeline mean to you? 2. Tell me about a data quality incidenthow did you detect it, fix it, and prevent it? 3. How do you implement incremental loads reliably when source systems dont provide CDC? 4. How would you build restartability into a pipeline from day 1? 5. Where does data virtualization fit vs physical ingestion into a lake/warehouse? 6. How do you support

Easy Apply

Contract, Third Party

50 - 58

Data Engineer

Remote or Dallas, Texas

•

Today

Job Role: Data Engineer Location: Dallas, TX Duration: Long Term project Full Time Position Job Description: Data Engineer skilled in building scalable cloud data pipelines for high-volume manufacturing and IoT data using Spark, Kafka, Airflow, and Delta Lake. Strong SQL and Python proficiency with hands-on experience in medallion/ Lakehouse architectures on Databricks, Snowflake, AWS, or Azure. Required Skills: Minimum 5+ years of experience (No limit of years of experience for a right cand

Full-time

$DOE

Google Cloud Platform Architect

Remote

•

6d ago

Required Qualifications: 10+ years of professional experience in Java development with focus on large-scale/high-data-volume distributed systems Strong experience with Spring Boot framework , Cloud services (preferably Google Cloud Platform) for building cloud-native microservices architectures Hands-on experience with Apache Beam and stream processing frameworks (Dataflow, Flink, or Spark Streaming) Hands-on/Production experience with Google Pub/Sub, Google Cloud Spanner, Redis or other mes

Easy Apply

Contract

65 - 70

Multiple Databricks Positions

Remote

•

4d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

Senior Data Scientist ( only W2)

Remote

•

3d ago

Senior Data Scientist - Remote (W2 Only) Overview The Senior Data Scientist will be a cornerstone of our AI/ML organization, spearheading the design and deployment of advanced predictive models, NLP solutions, and AI-powered tools that define how we understand and act on risk across our caregiver support platform. The ideal candidate brings the depth to work across the full data science stack from classical machine learning and survival modeling to large language models and conversational AI

Easy Apply

Contract

Depends on Experience

Big Data / Hadopp Engineer

Hybrid in Arlington, Virginia

•

2d ago

We have 2 open roles- one for Engineer (7-10 years) and another for Senior / Lead Engineer (12+ years) Big Data / Hadoop Engineer Python/Scala, Spark, Hadoop Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it. Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality. High proficiency in using Python or Scala, Spark, H

Easy Apply

Full-time

$125,000 - $140,000

Senior Data Scientist (Consumer Technology space)

Remote

•

Today

Kindly no 3rd parties. Please no 3rd parties. Please no VISAs that need sponsorship. American-born candidates who graduated from universities and colleges are sought. If you are a data engineer or AI/ML developer, KINDLY do not respond to this unless you have a degree in Data Science. Seeking Data Scientists who graduated from top 30 Universities/Colleges working in the business of CONSUMER TECHNOLOGY. Seeking people working at top technology companies only. Examples of Consumer Technology Smart

Easy Apply

Contract

$125 - $135

Apache Spark jobs in Virginia, USA