Apache Spark Jobs in Virginia

Refine Results
21 - 40 of 524 Jobs

Fullstack Python Developer

Cosmic-I LLC DBA Northern Base

•

Remote

Full-time

Jib Title: Fullstack Python Developer Location: 100% Remote Type: Fulltime Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks.Experienced in MVW frameworks like Django, /Django and jQuery. Experienced in developing web-based applications using Python, Django, PHP, XML, CSS5, HTML, DHTML, JavaScript, RabbitMQ, Jdk1.7.Excellent Programming skills at a higher level of abstraction using Scala and Spark.Experience in project
Easy Apply
Posted 2 days ago

Agentic Data Engineer

Beacon Systems, Inc

•

Richmond, Virginia, USA

Third Party, Contract

About Beacon Systems, Inc Beacon Systems, Inc, delivers Program Management, Science, Engineering, and Technology Solutions to Federal, Commercial, State, and Local Agencies. We are a subsidiary of Radiant Digital Solutions. Our Technology support to many DoD Agencies, NASA, Voice of America, FDA, and State Agencies such as State of FL, RI, MS, ND, VA, and WV extends our delivery of solutions worldwide. Position: Agentic Data Engineer Duration: 1 Months plus Location: Hybrid - Richmond, VA 23219
Easy Apply
Posted 1 day ago | Updated 1 day ago

Data Engineer

Ajace Inc

•

Arlington, Virginia, USA

Full-time

Key Responsibilities and Essential Duties: Build complex data solutions in an Azure Cloud environment.Maintain the Azure components and services.Develop architecture changes using infrastructure as code.Create data architectures diagrams for complex data modeling solutions.Create and maintain data dictionaries for contextualizing data from disparate sources.Enable end-to-end automation for deployment using continuous integration and continuous delivery.Implement data pipelines to ingest data to
Easy Apply
Posted 28 days ago

Sr. Big Data Developer - W2 Resource Only

Nasscomm, Inc.

•

Remote

Contract

Big Data Developer - Minimum 6 yrs of experience in Cloud, Big Data, Spark & Scala - Must have skill : Experience in Spark and Scala with exposure about cloud platforms ( AWS, Azure, Google Cloud Platform) for big data processing and storage - Strong experience in Azure DLS - Strong experience in Databricks, data pipelines - Experience in Hadoop seeking someone with strong backend development expertise, particularly in Java (Spring framework) - Agile delivery experience
Easy Apply
Posted 8 days ago | Updated 22 hours ago

ML Data Infrastructure Engineer

DVARN

•

Remote

Contract

Role: ML Data Infrastructure Engineer Location: Sunnyvale, CA OPEN FOR 100% REMOTE Duration: 12 Months Candidates should have strong experience in Deep Leaning ML frameworks and model serving technologies which is lacking in most of the resumes. JD: 8+ years of software engineering experience, with 3+ years in ML serving/infrastructure\ Strong expertise in container orchestration (Kubernetes) and cloud platforms Experience with model serving technologies (TensorFlow Serving, Triton, KServe) Deep
Easy Apply
Posted 28 days ago

Data Engineer (Middle) ID35916

Agile Engine

•

Remote

Full-time

What you will do Build and support ETL pipelines;Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;Working with Terraform to build AWS infrastructure;Analyze sources and build Cloud Data Warehouse and Data Lake solution.Must haves 3+ years of professional experience with Python;3+ years of pr
Easy Apply
Posted 3 days ago | Updated 3 days ago

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

•

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet
Easy Apply
Posted 2 days ago | Updated moments ago

763232 - Agentic Data Engineer

App Maisters

•

Richmond, Virginia, USA

Contract

Role : Agentic Data Engineer Location: Richmond, VA (Hybrid) Need candidate within 2hrs drivable distance Interview Mode: Both Phone and In Person Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems.
Easy Apply
Posted 2 days ago

Data Engineer III

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer . Responsibilities: * Developing/refactoring/optimizing real time data processing applications using apache Flink * Developing/refactoring/optimizing batch data processing applications using apache spark * Migration of real time data pipelines to isolated kafka infrastructure and coordinate migration efforts with consumers * Operational monitoring and on-call support for business critical applications *
Posted 7 days ago | Updated 9 hours ago

Sr. Lead Data Engineer/Architect

iTech US, Inc.

•

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda
Easy Apply
Posted 1 day ago | Updated 19 hours ago

Data Engineer (Middle/Senior) ID34675

Agile Engine

•

Remote

Full-time

What you will do Collaborate with engineers, architects, data scientists, analytics teams, and business stakeholders in an Agile setup;Build, and support both Cloud and On-Premise enterprise data infrastructure;Design and implement robust, reusable, and scalable data pipelines to automate ingestion, processing, and delivery of both batch and streaming data (structured and unstructured);Develop data APIs and delivery services to support critical business processes, analytical models, and ML appli
Easy Apply
Posted 24 days ago

Palantir Data Integration Engineer

CogniSoft Technologies

•

Remote

Contract

Job Title: Palantir Data Integration EngineerLocations: 100% REMOTE Job Description:A Palantir Data Integration Engineer is responsible for designing, developing, and maintaining data integration solutions using Palantir's software platform. In this role, you will work closely with stakeholders to develop scalable data pipelines, build robust applications, and integrate various data sources to drive impactful decision-making. You ll contribute to the full software development lifecycle, from req
Easy Apply
Posted 27 days ago

Senior Data Engineer

Precision System Design Inc.

•

Remote or Cleveland, Ohio, USA

Contract

Are you an experienced Data Engineer looking for a change? Do you want to work with cutting edge technology for an established Fortune 100 company on a fully remote basis? Our client is looking for a Data Engineer to help develop, maintain, and enhance the capabilities of their data platform. You'd build out data pipelines to support data science models to enable automated data processing and increased efficiency. You'd also help support packaging and deploying models to production, and developi
Easy Apply
Posted 17 days ago | Updated 3 hours ago

AWS Databricks Architect

Chabez Tech LLC

•

Remote

Contract

Position: AWS Databricks Architect Location: Remote Job Description: We are seeking a highly experienced AWS Databricks Architect to lead the architecture and design of scalable data solutions within the AWS cloud ecosystem for ThermoFisher. The ideal candidate will bring deep expertise in cloud-native data processing, analytics, and architecture, along with strong leadership capabilities to drive large-scale projects. Responsibilities:Design and implement end-to-end cloud data architectures us
Easy Apply
Posted 2 days ago

Databricks Architect

P2PSoftTek Inc

•

Remote

Contract

Looking for 15 plus years of overall experience Need Financial Domain Experience Responsibilities Design, implement, and deploy data platforms at scale in both public and private clouds Guide clients in establishing their data strategy, including data governance, data architecture, and data quality management Educate clients on modern technologies, architectures, and approaches for data & analytics Drive discovery phases, understand business problems, and propose technical solutions to address t
Easy Apply
Posted 6 days ago

Senior Data Engineer

Metasys Technologies

•

Remote or Las Vegas, Nevada, USA

Contract

Senior Data Engineer Las Vegas, NV (onsite) 6+ Months Project (Contract to Perm) Our prestigious $1B revenue per year client is seeking Senior Data Engineers to join their cutting-edge team, driving forward-thinking technology solutions for the future. This opportunity has the potential to convert into a salaried role. The Senior Data Engineer is responsible for designing, building, and managing the data platform and tools to allow for the efficient processing and analysis of large data sets. D
Easy Apply
Posted 60+ days ago | Updated 9 hours ago

Systems Engineer

Amentum

•

Dahlgren, Virginia, USA

Full-time

Amentum is seeking a Systems Engineer to join our engineering team in Dahlgren, VA. Like learning about new systems and leading-edge weapon systems capabilities? Come learn and explore new technologies, new software, new hardware, and development tools in support of the Submarine Launched Ballistic Missile Program. Along the way, advise the Government by researching new concepts and technologies and developing and installing new Fleet capabilities. Collaboration with teams across Strategic Syste
Posted 14 days ago | Updated 7 hours ago

Agentic/AI/ML Data Engineer

Innosoul inc

•

Richmond, Virginia, USA

Contract, Third Party

Job ID: VA-763232 Hybrid/Local Agentic/AI/ML Data Engineer (15+) with Big data, ETL, ELT, Spark, GraphDB, Azure Databricks/Lakes/Blob/Computer Vision/Video Indexer/OpenAI/Media Services/AI Search, Data Partitioning/conflation, Python, LLMs, GIS spatial data experience Location: Richmond, VA (VDOT) Duration: 13 Months Position: 1(2) Skills: Understanding the Big data Technologies Required 1 Years Experience developing ETL and ELT pipelines Required 1 Years Experience with Spark, GraphDB, Azure D
Easy Apply
Posted 2 days ago

Solution Architect - Nvidia AI

eGrove Systems Corporation

•

Remote

Contract

Solution Architect - Nvidia AI 100% remote looking for a Solution Architect that specializes in NVidia technology. The right candidate will be able to effectively assess client environments and needs to then work with engineers and infrastructure teams to implement NVidia and AI/ML technologies. They will be helping to build out CDW's AI/ML consulting team for their clients. They will oversee the projects and engineering execution on projects, from conception to execution. Top Candidate :- Dee
Easy Apply
Posted 2 days ago

Solution Architect

Techno-Comp, Inc.

•

Remote

Third Party, Contract

Title: Solution Architect Location: New York, NY (Remote) Duration: Long Term Skills needed: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/BigQuery/Synapse/Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streaming, Signals to NetworkBa
Easy Apply
Posted 23 days ago | Updated 20 hours ago