Apache Spark jobs in Virginia

Remote

•

21d ago

Job Description: We are looking for a Senior Data Engineer to support the State of Nebraskas Medicaid Encounter Processing and enterprise data ingestion platform. The ideal candidate will be responsible for development, production support, performance tuning, troubleshooting, and enhancement of distributed data applications. Required Skills: 7+ years of enterprise data engineering / distributed data processing experience Strong hands-on Scala Apache Spark 2.x / 3.x Hive 3.x Drools Rules Engine C

Easy Apply

Contract

60 - 65

Databricks Engineer

Remote

•

3d ago

Over 8 Years of experience in IT. Design and implement end-to-end lifecycle of Databricks platform on AWS.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource managem

Easy Apply

Contract

Depends on Experience

Senior Databricks Engineer

Remote

•

2d ago

Position: Senior Databricks Data Engineer Location: Remote / Hybrid Duration: Long Term Responsibilities Develop scalable data pipelines using Databricks, PySpark and SQL.Build and maintain Delta Lake tables using the Medallion Architecture.Develop batch and real-time data processing pipelines.Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.Optimize Spark jobs, SQL queries and Delta tables.Implement data governance and security using Unity Catalog.Develop Databricks Work

Easy Apply

Contract, Third Party

Depends on Experience

RSAs/Sr. FDEs - Remote

Remote

•

2d ago

Role: RSAs/Sr. FDEs Longterm Contract Location: 100% Remote JD: Very senior Solution Architects; need to be deeply technical, hands-on, and very Consultative; Lakebase and Genie experience is a big plus The client needs RSA with databricks architect (or ) Lead data bricks is also okay with architect experience. Key Requirements: Strong hands-on Databricks Platform experience PySpark, Spark SQL & Delta Lake Lakehouse Architecture Unity Catalog Governance & Security Delta Live Tables (DLT) Datab

Easy Apply

Contract, Third Party

75+

Big Data Engineer

Hybrid in Reston, Virginia

•

3d ago

Position Summary The Big Data Engineer will design, develop, and maintain big data ecosystem to support advanced analytics and data-driven decision-making across engineering, procurement, and construction workflows. This role is pivotal in enabling scalable, secure, and efficient data solutions for projects in semiconductor, electric vehicle, advanced materials, and data center sectors. Job Dimensions Supervision Received: Reports to Digital Solutions Lead and works under general direction.Super

Easy Apply

Contract

Depends on Experience

ERP Data Engineer with Healthcare System

Remote

•

11d ago

Job Title: ERP Data Engineer with Healthcare System Location: Remote Duration: 12+ Months Skills Needed: ERP Data Engineer, Healthcare System, Workday, Infor, PeopleSoft Job Description Position Summary We are looking for a strong, hands-on Senior Data Engineer with solid experience working with ERP, financial/accounting, and healthcare/hospital management data. The ideal candidate should have strong data engineering skills and experience integrating complex data from systems such as Workday, I

Easy Apply

Contract, Third Party

$60 - $70

Data Engineer

Remote or New York, New York

•

Today

RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines, optimizing distributed data processing workloads, implementing data quality and observability frameworks, and resolving complex performance and production challenges across cloud-based data platforms. REQUIREMENTS: * Str

Contract

$74 - $74 hourly

Senior Data Engineer

McLean, Virginia

•

17d ago

Job OverviewWe are seeking a Senior Data Engineer to join a large-scale banking data migration initiative supporting the integration of Discover and Capital One platforms. The team is responsible for migrating and processing high volumes of customer and transactional data across banking products, including checking, savings, money market accounts, IRAs, and CDs. This is a data engineering and data pipeline-focused role, with a strong emphasis on Java, Spring Boot, Scala, Spark/PySpark, and AWS d

Easy Apply

Contract

65 - 80

Senior Data Engineer - With DataBricks

Remote

•

15d ago

Senior Data Engineer - With DataBricksIntroduction: We''re seeking an experienced Data Engineer with expertise in data engineering across major data platforms. The ideal candidate will have a strong background in Python, SQL, ETL, and data modeling, with experience in tools like Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud knowledge (AWS, Azure, or Google Cloud Platform) is a plus. The role requires a willingness to transition and upskill into Databricks & A

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote

•

25d ago

Role Summary As a Data Engineer you ll design and build the data infrastructure that powers analytics, AI, and client-facing platforms across our portfolio of engagements. You ll sit at the center of our Data, Analytics & AI practice working alongside data scientists, analytics engineers, and solution architects to turn raw, complex data into reliable, production-grade pipelines. This isn t a support role. The pipelines you build directly shape what our clients can see, measure, and act on. The

Easy Apply

Contract

Depends on Experience

Databricks Architect / Resident Solution Architect

Remote or Hybrid in San Francisco, California

•

17d ago

Job Title: Databricks Architect / Resident Solution Architect Openings: 2 Location: San Francisco, CA Local preferred; Remote considered Work Hours: Must be able to work PST hours Duration: 812 Months Visa: Any Rate: flexible Industry: Banking / Financial Services Experience: 1215+ Years Job DescriptionWe are looking for a highly experienced Databricks Architect / Resident Solution Architect with strong hands-on Data Engineering and Databricks architecture experience. The ideal candidate should

Easy Apply

Contract

Depends on Experience

Lead Sr Software Engineer(Cloudera Hadoop stack)

Remote or Blue Bell, Pennsylvania

•

Today

Duration: 6 Months (C2H) Work Mode: 100% Remote Interview Type: Virtual (2 Rounds) Job Summary Our client is a leading healthcare analytics and solutions company that leverages vast clinical and financial datasets to generate insights that improve financial performance, reduce operational inefficiencies, and enhance healthcare quality across the system. We are seeking an experienced Senior Software Engineer to lead the design, development, and modernization of high-quality software applicati

Easy Apply

Full-time, Part-time, Contract, Third Party

USD 74-74

Cloud Computing / Data Engineer - Entry Level

Remote

•

9d ago

We are seeking a motivated and detail-oriented Entry-Level Cloud Computing / Data Engineer to join our technology team. The ideal candidate will assist with developing data pipelines, managing cloud-based data solutions, processing datasets, and supporting cloud infrastructure and data engineering projects. This is an entry-level position and does not require senior-level experience. Candidates with 02 years of experience, entry level candidates, internships, academic projects, bootcamp training

Easy Apply

Contract

20 - 25

Python Developer

Reston, Virginia

•

Yesterday

Systems Engineering Services is seeking an AI/Python Developer with a Java Certification based out of the Washington DC/Reston area. Top 5 Technical Skills: Python Gen AI SQL AWS Data Services LLM ML Sagemaker Bedrock Top 3 Soft Skills: Confidence in Communication skills for Teamwork and sharing Stand alone to get work done, Independent Flexibility Job Description: Experience: 10+ years overall in Software Engineering disciplines, preferably in the financial services industry 2-3 years of expe

Easy Apply

Full-time

Depends on Experience

AI Engineer

Remote

•

5d ago

Position: AI Engineer Location: Remote Duration: Long-Term Contract Key Responsibilities: AI Application Development Develop and enhance AI-powered applications using LLMs, RAG frameworks, and modern AI services.Build and integrate APIs, AI workflows, and automation solutions under the guidance of senior team members.Support implementation of AI use cases using GitHub Copilot, Claude, Azure AI Services, OpenAI models, and Databricks.Participate in evaluating and testing new AI tools and technolo

Easy Apply

Contract

Depends on Experience

Databricks Solutions Architect

Remote

•

Today

Databricks Solutions Architect 100% Remote 12 months plus Core Responsibilities Some of the major responsibilities for an RSA are: Engage with customers on short- to mid-term professional services projects using the Databricks platform (data engineering, data science, cloud). Design and build reference architectures, help with production-level use cases and deployments of big data / AI applications. Collaborate with engagement/project managers, customer teams, and internal engineering/support te

Easy Apply

Contract

Depends on Experience

Architectural Designer, Community

McLean, Virginia

•

Today

Little, nationally recognized as a "Best Firm to Work For" and one of the nation's most progressive design firms, is seeking an Architectural Designer with a passion for high quality design and a positive, collaborative work style, for our growing Community Studio in our DC (Tysons Corner) office. Responsibilities include: Providing conceptual design and design support documentation (Conceptual physical and digital models, renderings, diagrams, technical drawings) as part of teams working on a

Full-time

AI/Machine Learning Engineer with Databricks

Remote

•

Today

We are looking for a hands-on AI/Machine Learning Engineer with proven experience deploying and running optimized feature engineering (offline and online), model training, and inference pipelines. Experience with unstructured data processing and Spark Streaming is a must. Real-time feature generation and inference are required for this project, along with batch pipelines for model training. Responsibilities Design and optimize feature engineering pipelines for both batch and real-time workloads

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

Data Engineer

Remote

•

12d ago

Job Description: Role: Senior Data Engineer Location: Remote Duration: Full Time Job Description Seeking a Senior Data Engineer with strong hands-on experience in Databricks, Spark, and AWS to build scalable, secure data pipelines and lakehouse solutions supporting analytics, AI/ML, and healthcare data. Key Responsibilities Design and build data pipelines using Databricks, Delta Lake, Spark, Unity Catalog, and Workflows.Develop batch and real-time pipelines using AWS S3, Glue, Redshift, Athena,

Easy Apply

Full-time

Depends on Experience

Apache Spark jobs in Virginia, USA