Apache Spark jobs in Virginia

Remote

•

13d ago

Year of exp In Synapse, Year of exp in IAAS, SQL Server Year of exp in ADLS Gen 2 Year of exp in Azure Automation account runbooks using PowerShell, spark, scala programming Data Engineer PST time zone only Remote Key skills Synapse, IAAS, SQL Server, ADLS Gen 2, Azure Automation account runbooks using PowerShell, spark, scala programming 1. Experience with Azure technologies like Synapse, IAAS VM, SQLserver and ADSL Gen 2 2. Experience with developing, maintaining, and debugging Azure automa

Easy Apply

Contract

$30 - $55

Python Developer

Reston, Virginia

•

Yesterday

KMM an ISO 9001:2015, CMMI Level 2 certified company provides high-quality IT consulting services and innovative solutions by using the most effective and modern technologies. We have a core group of Subject Matter Experts with certifications and immense experience in successfully delivering mission-critical solutions. We have extensive industry experience in the financial, insurance, Health IT, media, marketing, retail, and government markets. We have a proven track record in understanding clie

Easy Apply

Contract, Third Party

Scala Developer (Mid-Level) - W2 - Remote (Posted by SAM)

Remote

•

10d ago

Must-haves: Hands-on Scala experienceUnderstanding of AWS cloud technologiesPractical knowledge of Apache KafkaFamiliarity with Spark Structured Streaming (in Scala)Experience with Git

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote or Hybrid in Blue Ash, Ohio

•

Today

Payrate: $65.00 - $76.45/hr. Summary: The team is looking for a Data Engineer experienced in implementing data solutions in Azure. The Data Engineer will analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. The Data Engineer will also support the implementation of Infrastructure as Code (IaC) by working with teams to help engineer scalable, reliable, and resilient software running in the cloud. Accountable for dev

Easy Apply

Contract

$65 - $76.45 hr

Cloud DevOps Administrator Expert

Remote

•

27d ago

Job Summary- 100% Remote We are seeking a Cloudera Data Engineer to support the migration of a Medicaid Data Warehouse Implementation in AWS environment. The resource will support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another. This position is responsible for ensuring a seamless transition, validating data integrity and job performance, and maintaining reliable daily operations post-migration. The role wi

Easy Apply

Contract, Third Party

Depends on Experience

Back-End Engineer

Richmond, Virginia

•

Yesterday

Title: Senior Back-End Engineer Job Type: Fulltime/Contract on W2 Duration: 12+ Months Locations: Must sit onsite in Richmond, VA or McLean, VA hybrid Back End Engineer (Java, ETL, SPARK, AWS, Glue) Technologies Used: Programming language: Java Familiar with Glue, Step Functions, SNS, SQS, Lambda, S3 Open source frameworks

Easy Apply

Third Party, Contract

Pre-Sales Technical Architect

Remote

•

18d ago

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environ

Easy Apply

Full-time

$150,000 - $170,000

Sr Data Engg Lead dev with Strong Databricks and Python experience 100% remote

Remote

•

7d ago

Location:100% Remote Type: Contract Industry: Healthcare Client is transitioning from SAS to Databricks to power next-generation actuarial analysis, underwriting, and risk modeling. Were seeking a Data Engineer to lead this transformationrefactoring legacy SAS pipelines, modernizing data architecture, and building scalable solutions on Databricks and Azure.What Youll Do Migrate and refactor SAS-based actuarial and underwriting models to Databricks Design and implement scalable data pipelines usi

Easy Apply

Contract

Depends on Experience

Senior Observability Data Engineer

Remote

•

Today

Key Responsibilities: Build and scale enterprise-grade telemetry pipelines (logs, metrics, traces).Develop ingestion & transformation workflows (Cribl, Vector, Jenkins, GitHub Actions).Architect Observability Lakehouse aligned with OTEL data models.Build ETL/ELT frameworks, Delta Lake processes, and data quality checks.Collaborate with Security, SRE, Cloud, and SOC teams.Develop CI/CD workflows and IaC patterns (Terraform, etc.).Troubleshoot pipeline performance and optimize for reliability and

Easy Apply

Full-time

$60

AI Architect

Remote

•

9d ago

Job Title: AI Architect Location: Remote/travel Duration: 7 months+ contract Number of Positions: 4 roles. Description: Design and implement AI/ML architectures and workflows to support project deliverables. Build and optimize production-grade machine learning models and pipelines for structured and unstructured data. Collaborate with cross-functional teams to translate business challenges into AI-driven solutions. Develop scalable solutions leveraging cloud-based AI services and big data tech

Easy Apply

Contract, Third Party

Healthcare Data Engineer

Remote

•

19d ago

About ISG International Solutions Group (ISG) An award-winning IT services company. Our company is based in Herndon, VA with offices in all major cities across the United States. We have been a trusted partner to some of the world s biggest companies for almost 22 years. At ISG we provide high-quality solutions in several areas of IT and build customized solutions for our clients. Here is our open requirement which can be filled immediately. Kindly respond to this requirement with your contact i

Easy Apply

Contract

Depends on Experience

W2 -AWS Data Engineer

Reston, Virginia

•

9d ago

AWS Data EngineerLocation: Reston, VA(Onsite)Contract Type: W2Job Requirement Work with product owners and other development team members to determine new features and user stories needed in large/complex development projects Create or Update documentation in support of development efforts. Documents may include detailed specifications, implementation guides, architecture diagrams or design documents. Participate in code reviews with peers and managers to ensure that each increment adheres to

Easy Apply

Contract

Depends on Experience

Data Warehouse Administrator

Remote or Salt Lake City, Utah

•

5d ago

Data Warehouse Administrator Remote 6 months MADlib, PXF, GPCC, gpfdist, gpload, gpbackup/gprestore, gpdr backup/restore SQL development skills in data warehousing environments Bash scripting and Python UNIX/Linux (RHEL) environments Terraform or other infrastructure-as-code tools ETL technologies (e.g., IBM DataStage) cloud platforms (AWS, Google Cloud Platform, Azure) Databricks and Spark-based data processing containerization (Docker, Kubernetes) and CI/CD pipelines

Easy Apply

Contract, Third Party

Cloud Data Engineer

Remote

•

25d ago

Habemco is a shared services company wholly owned and operated by the Habematolel Pomo of Upper Lake, a federally recognized Native American tribe located in Northern California. Habemco s support services such as product development and technology which are needed for business growth, ultimately power the Tribe s economy, and enable the delivery of education, health care and elder support programs for the Tribal community. Our talented team provides cross-functional support services to various

Easy Apply

Full-time

Depends on Experience

Databricks Data Engineer

Remote

•

23d ago

Databricks Data EngineerOur client is seeking a Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise-scale Microsoft Azure-based data analytics platform. You will support continued maintenance of ETL operations and development of new pipelines, ensuring data quality and data management. The ideal c

Easy Apply

Contract

$80 - $85

Databricks Engineer

Remote

•

5d ago

Position Description: Client: Federal Government Job Title: Databricks Engineer Location: Remote Duration: 11+ Months Experience Level: 10+ Years Required Skills and Experience: Technical Expertise: 3 5 years of hands-on experience with Databricks, including Spark-based data processing and orchestration.Proficiency in configuring and managing Azure services to support data platforms, including provisioning resources, implementing security controls, and optimizing performance for data storageStr

Easy Apply

Contract

$70 - $100

Need Technical Product Manager - Remote

Remote

•

Today

Job Role: Technical Product Manager (TPM) with Finance Location - Remote Duration: Long Term Skills: 15+years of Experience in Technical Product Management.Background in Data Engineering. Familiarity with Data Lakes and Data Platform architectures Required Qualifications 15+ years of experience in Technical Product Management, with a focus on technical/enterprise products.Strong background in Data Engineering, with hands-on understanding of data ingestion, ETL/ELT pipelines, data modeling, and d

Easy Apply

Contract, Third Party

Depends on Experience

Data Architect

Remote

•

4d ago

Role :: Data Architect Location :: Remote Type :: Fulltime Job Description Must Have Technical/Functional Skills: Strong expertise in data modeling techniques (conceptual, logical, physical). Proficiency in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). In-depth knowledge of data warehousing concepts and tools (e.g., Redshift, Snowflake, Google BigQuery) Experience with big data platforms (e.g., Hadoop, Spark, Kafka). Familiarity with cloud-based data platforms and servic

Easy Apply

Full-time

Depends on Experience

Java Developer (Back-End)

Hybrid in McLean, Virginia

•

Today

We are seeking a highly skilledBack End Java Engineerwith hands-on experience inETL development, Spark processing, and AWS-based data workflows. The ideal candidate will be responsible for designing, developing, and optimizing backend services, data pipelines, and integrations that power large-scale distributed systems. Required Skill: 12+ yearsof professional experience as aBackend or Java Engineer. Strong proficiency inJava(Core Java, Collections, Multithreading, Streams). Hands-on experience

Easy Apply

Third Party, Contract

Depends on Experience

Senior ML Engineer

Remote

•

Today

WHO ARE WE? Launch Potato is a profitable digital media company that reaches over 30M+ monthly visitors through brands such as FinanceBuzz, All About Cookies, and OnlyInYourState. As The Discovery and Conversion Company, our mission is to connect consumers with the world's leading brands through data-driven content and technology. Headquartered in South Florida with a remote-first team spanning over 15 countries, we've built a high-growth, high-performance culture where speed, ownership, and

Full-time

Filter Results

Job post features

Posted date

Work settings

Employment type

Employer type

Work authorization

Apache Spark jobs in Virginia, USA