apache spark Jobs in virginia

Refine Results
1 - 20 of 420 Jobs

Senior Python Engineer with Spark

EPAM Systems

•

Remote

Full-time

We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data. You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure. This position offers remote se
Posted 60+ days ago | Updated 2 hours ago

Databricks Developer: Java Spark

Zolon Tech Solutions Inc

•

Remote

Contract

Databricks Developer: Java Spark Location: Remote Duration: Long Term Task Description: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data processing solutions on the Databricks platform, with a focus on integrating and transforming IRS datasets such as the Information Returns Master File (IRMF), Business Master File (BMF), and Individual Master File (IMF). This role requires advanced proficiency in Java and Apache Spark, and a deep understandi
Easy Apply
Posted 3 days ago

Data Engineer - Spark

Exl Service

•

Remote or Fremont, California, USA

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Data Engineer (Spark/Scala/Python)

XTGlobal

•

Virginia, USA

Contract

Data Engineer * Hybrid in Richmond Only W2 consultants. 5+ years of experience in at least one of the following: Java, Scala, Python/PySpark, SQL or Go 3+ years of experience with AWS, specifically EMR 3+ years of experience in open source frameworks Experience building high-volume data interactions and observability/monitoring tools will be a huge plus Required Skills : Spark Python, Java, or Scala EMR SQL MQ experience (Kafka, Kinesis, etc.) Please share resumes to
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

•

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 28 days ago | Updated 1 hour ago

Senior Big Data/ Spark Engineer - C13

Citi

•

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re
Posted 3 days ago | Updated 2 hours ago

Java Spark Developer - AVP

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an
Posted 17 days ago | Updated 2 hours ago

Java Spark Senior Developer AVP C12 (Irving)

Citi

•

Remote or Irving, Texas, USA

Full-time

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment. This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles. Responsibilities: Perform detailed impact analysis for code changes with understanding of dependencies across the application componentsDesign and
Posted 52 days ago | Updated 2 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 2 hours ago

Databricks Developer

Zolon Tech Solutions Inc

•

Remote

Contract

Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on DatabricksImplement data processing logic in Java 8+, leveraging functional programming and OOP best practicesOptimize Spark jobs for performance, reliability, and cost-efficiencyCollaborate with cross-functional teams to gather requirements and deliver data solutionsEnsure compliance with data security, privacy, and governance standardsTroubleshoot and debug production issues in distributed data en
Easy Apply
Posted 1 hour ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 28 days ago | Updated 28 days ago

Senior DevOps Engineer

Real Soft, Inc / Diversity Direct

•

Fort Belvoir, Virginia, USA

Full-time

Essential Job Responsibilities Support development and deployment of cloud infrastructure in AWS, especially EKS.Support development and deployment of non-cloud (Edge) infrastructure of on-premise and portable equipment.Automate deployment processes and ensure reliability and scalability of services.Manage and maintain Kubernetes containers and cloud infrastructure on AWS.Collaborate with development teams to integrate their applications into the infrastructure.Monitor and troubleshoot productio
Easy Apply
Posted 1 day ago | Updated 1 day ago

Data Engineer

Innova Solutions, Inc

•

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza
Easy Apply
Posted 9 days ago

Only Ex CapitalOne Needed - Data Engineer - Richmond/Mclean VA - Hybrid

Bright Sol

•

Richmond, Virginia, USA

Third Party, Contract

Role : Senior Data Engineer Location : Richmond/Mclean VA - Hybrid Skills Python, Spark/ PySpark, ETL, Postgres SQL, AWS- EMR- Ex cap Only
Easy Apply
Posted 7 hours ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 17 days ago

Informatica IICS Developer

Accuro Group

•

Virginia, USA

Third Party, Contract

Greetings from Accuro Group !! I have an urgent opening for the project mentioned below. Please let me know if you are comfortable with the requirements. Kindly share your resume @ Position: Informatica IICS Developer Location: McLean, VA (onsite) (only nearby states) Mandatory Skills: Expertise in Informatica Cloud Services (AWS) Expertise in Informatica Data Integration Expertise in Informatica Application Integration Expertise in SQL Queries Well versed & hands-on experience with Kafka, Spar
Easy Apply
Posted 1 day ago

Informatica IICS Developer

Source Code Technologies LLC

•

McLean, Virginia, USA

Contract, Third Party

Position: Informatica IICS Developer Location: McLean, VA (Onsite Candidates from nearby states only) Overview: We are actively seeking a highly skilled Informatica IICS Developer to join our team in McLean, VA. This is a hands-on role for someone with strong experience in Informatica Intelligent Cloud Services (IICS), Kafka, Spark, and SQL. If you're passionate about data integration and cloud technologies and are based in or around Virginia, we d love to hear from you. Key Responsibilities: De
Easy Apply
Posted 2 days ago

Agentic Engineer

Innova Solutions, Inc

•

Richmond, Virginia, USA

Third Party, Contract

Innova Solutions has a client that is immediately hiring for a Agentic Engineer Position Type: Full-time Contract Duration: 12+ Months Location: Richmond VA The position requires to be onsite for 3 days/week. As a Agentic Engineer, you will: seeking a highly skilled Agentic Engineer to design, develop that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems. ensure data quality and facilitating interaction between agents and d
Easy Apply
Posted 9 days ago

Agentic Data Engineer/ AI Engineer

Beacon Systems, Inc

•

Richmond, Virginia, USA

Third Party, Contract

About Beacon Systems, Inc Beacon Systems, Inc, delivers Program Management, Science, Engineering, and Technology Solutions to Federal, Commercial, State, and Local Agencies. We are a subsidiary of Radiant Digital Solutions. Our Technology support to many DoD Agencies, NASA, Voice of America, FDA, and State Agencies such as State of FL, RI, MS, ND, VA, and WV extends our delivery of solutions worldwide. Position: Agentic Data Engineer/ AI Engineer Location: Richmond, VA 23219 Duration: 5 Months p
Easy Apply
Posted 2 days ago | Updated 1 day ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 23 days ago | Updated 1 hour ago