Apache Spark jobs in Virginia

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, GenAI)

McLean, Virginia

•

Today

Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about data, data modeling, data quality, gov

Full-time

USD 179,400.00 - 204,700.00 per year

Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

McLean, Virginia

•

Today

Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Sr. Data Engineers who are passionate about data, data

Full-time

USD 229,900.00 - 262,400.00 per year

Senior Python Developer with Spark

Reston, Virginia

•

Today

U.S. - What we do matters By playing this video you consent to Google/YouTube processing your data and using cookies - Learn more . Position Description: We are seeking a Senior Python Developer with Spark skills to design, build, and optimize large-scale data processing systems in a cloud-native AWS environment. This role focuses heavily on developing high-performance data pipelines using Spark and Python, as well as working with complex relational datasets. We partner with 15 of the top 20 b

Full-time

USD 99,200.00 - 154,300.00 per year

Cloudera Platform Engineer

Remote or California

•

12d ago

Technical Skills Primary Minimum 5 years of experience on Cloudera Platform management configuration Handson experience with Cloudera on prem platform components HDFS Hive Yarn Spark Kafka HBase Experience with Cloudera Data Platform including installation configuration patching scaling performance tuning Good at cluster capacity planning and file system management Hands on experience with Kerberos RangerSentry and HDFS encryption Backup and recovery strategies for HDFS and Metadata services Des

Easy Apply

Third Party, Contract

$DOE

Data Engineer (Spark + HBase + Java)- 100% Remote- Only w2

Remote

•

5d ago

Key ResponsibilitiesDevelop and maintain data pipelines using Spark (PySpark/Scala/Java)Work with HBase and Hadoop ecosystem tools (Hive, Impala, Hue)Process large datasets in distributed environmentsCollaborate with backend teams for data integrationOptimize performance of data processing jobsSupport data ingestion, transformation, and storage solutionsParticipate in testing and performance tuningRequired SkillsStrong experience with Apache Spark (must-have)Hands-on with HBase (must-have)Good p

Easy Apply

Contract, Third Party

Depends on Experience

Senior Data Architect

Remote or Hybrid in Texas City, Texas

•

19d ago

Contract description Key Responsibilities Database & System ArchitectureDesign and implement scalable, secure database architectures for transactional and analytical use cases. Define data models, partitioning strategies, indexing, and normalization standards. Ensure data integrity, reliability, and maintainability across enterprise systems. Support architectural decisions for high-availability and fault-tolerant systems. Performance Tuning & OptimizationAnalyze and optimize complex SQL queries

Easy Apply

Contract

80 - 85

Databricks Data Engineer

Remote

•

29d ago

Job Title:Databricks Data EngineerLocation:Remote with Quarterly travel to Gaithersburg, MDDuration: 6 monthsPR: $68.50/hr on W2Security Clearance Required: PUBLIC TRUSTGreater DC Area preferredJob Description:Client is seeking a Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft A

Easy Apply

Contract

65 - 68

Informatica - Application Programmer - 6264606

Remote or Charlotte, North Carolina

•

Today

Accenture Flex offers you the flexibility of local fixed-duration project-based work powered by Accenture, a leading global professional services company. Accenture is consistently recognized on FORTUNE's 100 Best Companies to Work For and Diversity Inc's Top 50 Companies For Diversity lists. As an Accenture Flex employee, you will apply your skills and experience to help drive business transformation for leading organizations and communities. In addition to delivering innovative solutions for

Full-time

USD 50.00 - 54.00 per hour

Informatica - Application Programmer - 6264605

Remote or Charlotte, North Carolina

•

Today

Full-time

USD 50.00 - 54.00 per hour

Ab Initio developer

Richmond, Virginia

•

Today

Job Title: Ab Initio Developer ETL Location- Richmond / McLean VA Duration : 12+ Months Contract Must Haves : Ab Initio Spark Scala AWS Python Shell scripting Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30

Easy Apply

Full-time, Contract, Third Party

Microsoft Fabric Technical Architect

Remote

•

21d ago

Title: Microsoft Fabric Technical Architect Location: Denver, CO.(Remote) Contract: 12 Months Job Description: 12+ years overall experience in data engineering / data platform roles.2+ years of hands-on experience architecting and implementing on Microsoft Fabric.Strong proficiency in SQL (performance tuning, complex transformations, analytics-ready modeling).Hands-on expertise with Azure Data Factory (or Fabric pipelines), including orchestration patterns and parameterized pipelines.Strong hand

Easy Apply

Third Party, Contract

Depends on Experience

PySpark / Java Developer (Data Engineer)- 100% Remote- Only W2

Remote

•

Yesterday

Key ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines and data processing applicationsBuild and optimize data workflows using PySpark, Java, and Hadoop ecosystem toolsAnalyze business and technical requirements to produce detailed implementation designsPerform unit testing, integration testing, and debugging of applicationsTroubleshoot and resolve performance issues related to high-volume data processingDevelop and maintain SQL queries, stored procedures, and database objectsW

Easy Apply

Contract

Depends on Experience

Data/Modeling Engineer (ML Data Engineer)

Hybrid in Reston, Virginia

•

27d ago

Position: Data/Modeling Engineer (ML/Data Engineer)Location: Reston, VA (Hybrid)Duration: Long termRequired Skills & Experience Strong experience with AWS and ML engineering Proficiency in Python and MLflow Hands on expertise with Domino and SageMaker SDKs Experience with feature engineering and scalable data pipelines Knowledge of model validation, explainability, and bias/fairness tooling Familiarity with Git based workflows, version control, and MLOps practices Focused on manipulating d

Easy Apply

Full-time

60 - 70

Databricks Data Engineer

Remote

•

28d ago

Job Title: Databricks Data Engineer Location: Washington, DC Type: Contract Compensation: $62.00 - $75.00 per hour Contractor Work Model: Remote Hours: 40.0 hours per week Security Clearance: Must have an active Public Trust clearance Responsibilities Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture. Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multip

Easy Apply

Contract, Third Party

$62

HYBRID::Data Engineer at Rockville, MD or McLean, VA (Hybrid 3 days onsite with 2 days remote)::ONLY W2

Hybrid in McLean, Virginia

•

Today

Hello, Greetings.! This is Hima from Appridat Solutions LLC. I was reviewing your resume online and would like to talk to you regarding an exciting opportunity Data Engineer at Rockville, MD or McLean, VA (Hybrid 3 days onsite with 2 days remote)We have with one of Appridat Solutions LLC premier clients. Title: Data Engineer Location: Rockville, MD or McLean, VA (Hybrid 3 days onsite with 2 days remote) Duration: 6 Months with possible extension Interview process: Prescreen, Phone, Onsite panel

Easy Apply

Contract

Depends on Experience

Azure Data Engineer

Remote

•

6d ago

Role Senior azure Engineer Location: Remote (United States)Employment Type: Contract (W2) Duration: 6+ Months (Possible Extension)Key ResponsibilitiesDesign, build, and orchestrate scalabledata pipelinesusing Azure-native services.Develop and optimizebatch and near real-time data processing solutionsusing Spark and Databricks.Implement and manageenterprise-grade Lakehouse architectures(Medallion architecture).Performdata processing, validation, and automationusing Python (PySpark, Pandas, NumPy)

Easy Apply

Contract

50 - 55

AI Data Scientist

Remote

•

8d ago

Role OverviewAn AI Data Scientist is responsible for analyzing complex datasets and building AI/ML models to generate insights and drive intelligent decision-making. This role combines data science, machine learning, and AI techniques to solve business problems and develop predictive and generative solutions. Key ResponsibilitiesAnalyze structured and unstructured data to identify trends and patternsBuild, train, and evaluate machine learning and AI modelsDevelop predictive models, recommendatio

Easy Apply

Full-time

Depends on Experience

Database Modeler (W2 Contract) - Only Visa Independent Candidates

Remote

•

Today

Role: Database Modeler Location: Remote Must be commutable to any Fed headquarters or branch office (San Francisco, CA; Chicago, IL; NYC, NY; Richmond, VA; Kansas City, MO; Cleveland, OH; Charlotte, NC; Dallas, TX) Duration: 12 months, withpossible extension Type of Employment: W2 Contract Job Summary: We are seeking a Database Modeler with strong Data Mesh and Databricks expertise to design scalable data models and data products. This role focuses on building efficient data pipelines, ensurin

Easy Apply

Contract

Depends on Experience

Big Data Solutions Architect

McLean, Virginia

•

Today

As a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most value out of their data. RSAs are billable and know how to complete projects

Easy Apply

Full-time

$90 - $100

Sr. Software Engineer- 100% Remote

Remote

•

Yesterday

Job SummaryWe are looking for a Senior Software Engineer to design, develop, and enhance scalable software applications within a healthcare analytics product suite. This role requires strong expertise in big data technologies, backend development, and modern AI/LLM integrations, along with the ability to collaborate across distributed teams and mentor junior engineers Key ResponsibilitiesDesign, develop, and maintain high-quality, scalable software componentsBuild and enhance applications using

Easy Apply

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Employer type

Work authorization

Apache Spark jobs in Virginia, USA