apache spark Jobs in virginia

Refine Results
1 - 20 of 434 Jobs

Data Engineer (Spark/Scala/Python)

XTGlobal

•

Virginia, USA

Contract

Data Engineer * Hybrid in Richmond Only W2 consultants. 5+ years of experience in at least one of the following: Java, Scala, Python/PySpark, SQL or Go 3+ years of experience with AWS, specifically EMR 3+ years of experience in open source frameworks Experience building high-volume data interactions and observability/monitoring tools will be a huge plus Required Skills : Spark Python, Java, or Scala EMR SQL MQ experience (Kafka, Kinesis, etc.) Please share resumes to
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Jr. Data Engineer (Healthcare, Spark, Scala) - Remote

ConsultNet, LLC

•

Remote

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 16 days ago | Updated 1 hour ago

Java Spark Developer - AVP

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an
Posted 5 days ago | Updated 2 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 2 hours ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 16 days ago | Updated 16 days ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 5 days ago

Databricks Engineer

Showman Staffing

•

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des
Easy Apply
Posted 5 days ago

Senior Software Engineer

Skywaves MP LLC

•

Remote

Contract

This role contributes to the Engineering of large-scale solutions that enable client's business while supporting the strategic architectural vision leveraging AWS and AI to achieve quality, scalability, performance and function. Senior Software Engineer is an active member of a dynamic team looking to build Best in Class software. The ideal candidate for this role not only is able to produce high quality work quickly but also collaborates with others around them whenever possible, holding the te
Easy Apply
Posted 3 days ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 10 days ago | Updated moments ago

Only Full Time: AWS Data Engineer (All Visa Workable)

Visionary Innovative Technology Solutions LLC

•

Reston, Virginia, USA

Full-time

Job DescriptionPosition: AWS Data Engineer Location: Reston, VA (Onsite) Duration: Full Time Job Description: 9+ year experience Strong Python experience required Existing Client s AWS and mortgage experience is plus EMR/Spark development Experience Experience with tableau reporting
Posted 2 days ago | Updated 11 hours ago

Azure Databricks Engineer

Aptino

•

Remote

Contract, Third Party

Job Description: We are seeking a skilled Platform Engineer with strong expertise in Azure, Databricks, and Snowflake. The ideal candidate will be responsible for configuring and maintaining platform components, ensuring governance alignment, optimizing performance, and evaluating new platform features to support data engineering and analytics initiatives. Key Responsibilities: Align platform configurations with data governance and compliance standards. Evaluate and implement enhancements and ne
Easy Apply
Posted 12 days ago | Updated 1 hour ago

ETL Data Engineer

Innova Solutions, Inc

•

Reston, Virginia, USA

Contract

Innova Solutions has a client that is immediately hiring for IT Engineer V (ETL Data Engineer) Position type: Full Time, Contract Duration: 5 Months Location: Reston, VA (3 days/week Hybrid Onsite) As an IT Engineer V, you will be responsible for Ability to run the CDI-PC assessment and interpret the flags for IDMC conversion.Experience automating repetitive tasks related to provisioning of AWS Services, installation, configuration, or management of infrastructure using Terraform, Gitlab, Ansi
Easy Apply
Posted 31 days ago

Big Data Engineer

Infoway Software

•

Richmond, Virginia, USA

Contract

Must sit onsite in Richmond, VA hybrid Title- Big Data Engineer Python, Spark, SQL, AWS (Glue Batch - big files sets from 3rd party partner and use real-time API to get the data to make accessible to internal system
Easy Apply
Posted 11 days ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 17 days ago

Staff Data Scientist -- Direct Hire -- REMOTE Position (& Citizens ONLY)

Amtex Enterprises

•

Remote

Full-time

Staff Data Scientist Location: Remote- CST time working hours Salary: DOE QUALIFICATIONS: Master's or PhD degree in a machine learning/AI related field such as engineering, statistics, computer science, or physics 5+ years of industry experience in data science, data analytics, and machine learning in advertising domain Extensive experience in Real-Time Bidding (RTB) systems. Skilled in applying advanced data science methodologies to improve the efficiency, profitability, and competitiveness o
Easy Apply
Posted 19 days ago

Big Data Hadoop Engineer

Harvey Nash Inc.

•

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API
Easy Apply
Posted 33 days ago | Updated 26 days ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 5 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 11 days ago

Python Developer - W2 - Hybrid in McLean, VA or Richmond, VA (Need Locals)

Saksoft

•

McLean, Virginia, USA

Contract

Title - Python Developer Location: Hybrid in McLean, VA or Richmond, VA Duration: 12-month contract Interview Process: 1 round, 1 hour, 2nd round only if needed Must have previous Capital One Experience Required: -5-7+ years experience - Python (primary) and Java (secondary) - AWS: Lambda, ECS, EC2, Faregate - Kafka or Kinesis - Node.js - DynamoDB - RESTful APIs - Experience building data pipelines (Spark experience preferred) - Familiarity with performance testing is a plus
Easy Apply
Posted 5 days ago | Updated 5 days ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 10 days ago | Updated 3 days ago