Apache Spark jobs in Virginia

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

W2 Senior Data Engineer - Telecom Background, Python, BigQuery, Looker, Tableau, Power BI, Spark (PySpark)

Remote

•

2d ago

Senior Data Engineer - lead the technical delivery of a data and analytics program for a large enterprise telecom customer. You'll own the work from ingestion through to dashboards. You'll be the main technical contact with the customer's data and engineering teams, and you'll work with a distributed team that uses AI-assisted development every day. This is a 6 months contract with a potential to extend. Please note that candidates must be based in the United States and available to travel to c

Easy Apply

Contract

55 - 67

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Data Engineer

Richmond, Virginia

•

2d ago

Key ResponsibilitiesDesign and develop scalable batch and streaming data pipelines using Apache Spark and Scala. Build distributed data-processing solutions for high-volume structured and semi-structured datasets. Develop reusable data frameworks, transformation logic, and ingestion components. Optimize Spark applications for performance, scalability, partitioning, memory utilization, and execution efficiency. Build and maintain ETL/ELT pipelines across enterprise data platforms. Develop real-ti

Easy Apply

Contract

Depends on Experience

Spark or Java Developer

Springfield, Virginia

•

9d ago

Absolute Business Solutions Corp (ABSC) is not just another tech company. We're a community of innovators, engineers, analysts and business professionals working together with our customers to tackle the most complex challenges. For more than 20 years we've supported critical DoD, IC and Federal Civilian missions and global, multi-national corporations. We specialize in supporting our clients in the Intelligence, Technology, Defense, AI/ML, and Data Science fields. As we continue to grow at a ra

Full-time

USD 150,000.00 - 275,000.00 per year

Spark or Java Developer

Herndon, Virginia

•

9d ago

Full-time

USD 150,000.00 - 275,000.00 per year

Python Engineer / Senior Data Engineer with AI Experience

Remote

•

3d ago

Job Title: Python Engineer / Senior Data Engineer with AI Experience Location: Remote Duration 6 month contract to hire Job Description: Overview: At a high level, they have migrated from Hadoop to Google Cloud Platform for data processing. Have a Google Cloud Platform data environment, predominantly for big data applications on the cloud. Seeking 3-5 Senior Level Data Engineers with strong Python skills to support ongoing data migration and ingestion efforts. Source systems: get data from multi

Easy Apply

Contract

$50 - $60

Databricks Engineer

Remote

•

6d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Contract, Third Party

$70 - $80

Data Architect

Remote

•

17d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Ab Initio ETL Data Engineer

Glen Allen, Virginia

•

5d ago

Title: Ab Initio ETL Data Engineer Location: Richmond, VA (3 Days Hybrid) Duration: 7 Months with possible extension Tech Skills: Data movement and transformation Scrubbing and moving production data into QA environments ETL pipeline development Ab Initio - Must Have Preferred Skills Spark Scala Python AWS Data processing frameworks Job Summary We are seeking an experienced ETL / Data Engineering Developer to design, develop, and maintain data pipelines and ETL processes. The ideal candid

Easy Apply

Contract, Third Party

Depends on Experience

Sr. Databricks Architect

Remote

•

30+d ago

Location: Remote Work Hours: Must be able to work in Pacific Time (PST) Duration: 12 Months Employment Type: Contract Industry Experience: Public Sector experience required Position Overview We are seeking an experienced Databricks Architect / Resident Solution Architect to design, develop, and deliver modern, scalable data platforms and solutions. The ideal candidate will have extensive experience in data engineering, cloud data platforms, Databricks implementations, and client-facing tec

Easy Apply

Contract, Third Party

$78 - $84

.NET Developer - HYBRID - W2

Hybrid in Richmond, Virginia

•

4d ago

Primary Accountabilities Leads an engineering team to meet project deadlines and priorities.Supervises assigned data engineering team members & activities.Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.Documents critical workflows and operational support aspects of teams responsibilitiesDevelops deep understanding of data sources, granularity, availability, and limitations.Provides proactive technical oversight and advice to application

Easy Apply

Contract, Third Party

Depends on Experience

Databricks Engineer with Health Insurance

Remote

•

3d ago

Over 8 Years of experience in IT. Design and implement end-to-end lifecycle of Databricks platform on AWS.Good experience in working with Healthcare insurance clients.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.Deep expertise i

Easy Apply

Contract

Depends on Experience

Databricks Engineer

Remote

•

3d ago

Easy Apply

Contract

Depends on Experience

Forward Deployed Engineer (Databricks)

Remote

•

10d ago

Senior Forward Deployed Engineer, Data & AI We''re looking for a hands-on engineer who thrives working side-by-side with clients to solve real-world data problems. You''ll be involved with technical delivery end-to-end building the data pipelines that move information from raw to ready, and the models that turn it into insight. What you''ll do: Partner directly with clients and product teams, translating business problems into technical requirements (and technical solutions back into plain-lang

Easy Apply

Contract

65 - 80

Senior Databricks Engineer

Remote

•

2d ago

Position: Senior Databricks Data Engineer Location: Remote / Hybrid Duration: Long Term Responsibilities Develop scalable data pipelines using Databricks, PySpark and SQL.Build and maintain Delta Lake tables using the Medallion Architecture.Develop batch and real-time data processing pipelines.Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.Optimize Spark jobs, SQL queries and Delta tables.Implement data governance and security using Unity Catalog.Develop Databricks Work

Easy Apply

Contract, Third Party

Depends on Experience

Lead Java Developer (Application Developement).............Remote W2 position

Remote

•

4d ago

Lead Java Developer (Application Development) Remote W2 position 6 months May work remotely but must work ET zone hours Glider assessment 30 minutes zoom video interviews Job Description Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologiesUtilize various programming languages, Open-Source technologies, Relational/NoSQL databases, Containers and a variety of AWS tools and services with a s

Easy Apply

Contract

Depends on Experience

Lead Sr Software Engineer (Cloudera Hadoop stack)

Remote

•

3d ago

Lead Sr Software Engineer (Cloudera Hadoop stack) REMOTE Visa Eligibility:Please confirm if the candidate is legally authorized to work in the United States Experience Level: 10+ years Contract 12 months Qualifications: Bachelors degree in computer science, Information Technology, Information Systems, or related field. 10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws. The ideal candidate will possess deep expertise

Easy Apply

Third Party, Contract

60 - 70

Iceberg DBA REMOTE

Remote

•

3d ago

Interview Mode :MS teams Must have :Iceberg DBA experience in Big Data / Data Operations / DBA roles Minimum 1+ year of experience with Apache Iceberg or similar table formats (Hive/Delta/Hudi) 4+ years of experience with Cloudera ecosystem (CDP)Hands-on experience with: Iceberg table operations and maintenance Spark SQL, Hive, or Impala Experience in: Production support and incident handling Monitoring, troubleshooting, and operational support Apply established data modeling and Lakehouse stand

Contract

$40 - $50

Apache Spark jobs in Virginia, USA