apache spark Jobs in virginia

Refine Results
21 - 40 of 518 Jobs

Senior General Data Architect

Amiseq Inc.

•

Remote

Contract

Job Description: * 15+ years in IT experience with a minimum 7+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current knowl
Easy Apply
Posted 32 days ago | Updated 25 days ago

Fullstack Python Developer

Cosmic-I LLC DBA Northern Base

•

Remote

Full-time

Jib Title: Fullstack Python Developer Location: 100% Remote Type: Fulltime Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks.Experienced in MVW frameworks like Django, /Django and jQuery. Experienced in developing web-based applications using Python, Django, PHP, XML, CSS5, HTML, DHTML, JavaScript, RabbitMQ, Jdk1.7.Excellent Programming skills at a higher level of abstraction using Scala and Spark.Experience in project
Easy Apply
Posted 3 days ago

Agentic Data Engineer

Beacon Systems, Inc

•

Richmond, Virginia, USA

Third Party, Contract

About Beacon Systems, Inc Beacon Systems, Inc, delivers Program Management, Science, Engineering, and Technology Solutions to Federal, Commercial, State, and Local Agencies. We are a subsidiary of Radiant Digital Solutions. Our Technology support to many DoD Agencies, NASA, Voice of America, FDA, and State Agencies such as State of FL, RI, MS, ND, VA, and WV extends our delivery of solutions worldwide. Position: Agentic Data Engineer Duration: 1 Months plus Location: Hybrid - Richmond, VA 23219
Easy Apply
Posted 2 days ago | Updated 2 days ago

Data Engineer

Ajace Inc

•

Arlington, Virginia, USA

Full-time

Key Responsibilities and Essential Duties: Build complex data solutions in an Azure Cloud environment.Maintain the Azure components and services.Develop architecture changes using infrastructure as code.Create data architectures diagrams for complex data modeling solutions.Create and maintain data dictionaries for contextualizing data from disparate sources.Enable end-to-end automation for deployment using continuous integration and continuous delivery.Implement data pipelines to ingest data to
Easy Apply
Posted 29 days ago

Sr. Big Data Developer - W2 Resource Only

Nasscomm, Inc.

•

Remote

Contract

Big Data Developer - Minimum 6 yrs of experience in Cloud, Big Data, Spark & Scala - Must have skill : Experience in Spark and Scala with exposure about cloud platforms ( AWS, Azure, Google Cloud Platform) for big data processing and storage - Strong experience in Azure DLS - Strong experience in Databricks, data pipelines - Experience in Hadoop seeking someone with strong backend development expertise, particularly in Java (Spring framework) - Agile delivery experience
Easy Apply
Posted 9 days ago | Updated 19 hours ago

ML Data Infrastructure Engineer

DVARN

•

Remote

Contract

Role: ML Data Infrastructure Engineer Location: Sunnyvale, CA OPEN FOR 100% REMOTE Duration: 12 Months Candidates should have strong experience in Deep Leaning ML frameworks and model serving technologies which is lacking in most of the resumes. JD: 8+ years of software engineering experience, with 3+ years in ML serving/infrastructure\ Strong expertise in container orchestration (Kubernetes) and cloud platforms Experience with model serving technologies (TensorFlow Serving, Triton, KServe) Deep
Easy Apply
Posted 29 days ago

Senior Data Engineer with Healthcare Domain

E-Solutions, Inc.

•

California, USA

Full-time

Hi Professionals, Title: AWS Data Engineer with Healthcare Domain Location: Remote Duration: Fulltime JD: Mandatory Skills :- AWS Databricks,PySpark or Spark, Data Pipeline,ETL ,SQL,Data Warehouse "Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty,
Easy Apply
Posted 14 hours ago | Updated 11 hours ago

Lead Healthcare Data Scientist with Azure

VLink Inc

•

Remote

Contract

Job Title: Lead Healthcare Data Scientist with Azure Location: Remote (EST Only) Employment Type: Contract Duration: 6 month initial contract About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients. Job Description: Lead Healthcare Data Scientist Key Skills: Healthcar
Easy Apply
Posted 19 hours ago

Principal ML OPS Engineer

ProHire Solution

•

Remote

Full-time

Job Location: 100% Remote (USA) Job Summary: We are looking for a seasoned Principal ML OPS Engineer to architect, build, and optimize ML inference platform. The role demands an individual with significant expertise in Machine Learning engineering and infrastructure, with an emphasis on building Machine Learning inference systems. Proven experience in building and scaling ML inference platforms in a production environment is crucial. This remote position calls for exceptional communication skil
Easy Apply
Posted 14 hours ago

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

•

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet
Easy Apply
Posted 2 days ago | Updated 8 hours ago

Data Engineer (Middle) ID35916

Agile Engine

•

Remote

Full-time

What you will do Build and support ETL pipelines;Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;Working with Terraform to build AWS infrastructure;Analyze sources and build Cloud Data Warehouse and Data Lake solution.Must haves 3+ years of professional experience with Python;3+ years of pr
Easy Apply
Posted 4 days ago | Updated 3 days ago

763232 - Agentic Data Engineer

App Maisters

•

Richmond, Virginia, USA

Contract

Role : Agentic Data Engineer Location: Richmond, VA (Hybrid) Need candidate within 2hrs drivable distance Interview Mode: Both Phone and In Person Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems.
Easy Apply
Posted 3 days ago

Data Engineer III

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer . Responsibilities: * Developing/refactoring/optimizing real time data processing applications using apache Flink * Developing/refactoring/optimizing batch data processing applications using apache spark * Migration of real time data pipelines to isolated kafka infrastructure and coordinate migration efforts with consumers * Operational monitoring and on-call support for business critical applications *
Posted 8 days ago | Updated 5 hours ago

Data Engineer

Raas Infotek LLC

•

Remote

Contract

Position: Data Engineer Type: W2 Contract We re looking for a Data Engineer to design, build, and optimize data pipelines that support enterprise analytics and digital transformation initiatives. This role is ideal for someone who thrives in a fast-paced, data-driven environment and has a strong background in modern data engineering tools and cloud platforms.Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using modern data frameworks Collaborate with data analysts, ar
Easy Apply
Posted 19 hours ago

Sr. Lead Data Engineer/Architect

iTech US, Inc.

•

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda
Easy Apply
Posted 2 days ago | Updated 1 day ago

Data Engineer (Middle/Senior) ID34675

Agile Engine

•

Remote

Full-time

What you will do Collaborate with engineers, architects, data scientists, analytics teams, and business stakeholders in an Agile setup;Build, and support both Cloud and On-Premise enterprise data infrastructure;Design and implement robust, reusable, and scalable data pipelines to automate ingestion, processing, and delivery of both batch and streaming data (structured and unstructured);Develop data APIs and delivery services to support critical business processes, analytical models, and ML appli
Easy Apply
Posted 25 days ago

Palantir Data Integration Engineer

CogniSoft Technologies

•

Remote

Contract

Job Title: Palantir Data Integration EngineerLocations: 100% REMOTE Job Description:A Palantir Data Integration Engineer is responsible for designing, developing, and maintaining data integration solutions using Palantir's software platform. In this role, you will work closely with stakeholders to develop scalable data pipelines, build robust applications, and integrate various data sources to drive impactful decision-making. You ll contribute to the full software development lifecycle, from req
Easy Apply
Posted 28 days ago

Senior Data Engineer

Precision System Design Inc.

•

Remote or Cleveland, Ohio, USA

Contract

Are you an experienced Data Engineer looking for a change? Do you want to work with cutting edge technology for an established Fortune 100 company on a fully remote basis? Our client is looking for a Data Engineer to help develop, maintain, and enhance the capabilities of their data platform. You'd build out data pipelines to support data science models to enable automated data processing and increased efficiency. You'd also help support packaging and deploying models to production, and developi
Easy Apply
Posted 18 days ago | Updated 1 hour ago

AWS Databricks Architect

Chabez Tech LLC

•

Remote

Contract

Position: AWS Databricks Architect Location: Remote Job Description: We are seeking a highly experienced AWS Databricks Architect to lead the architecture and design of scalable data solutions within the AWS cloud ecosystem for ThermoFisher. The ideal candidate will bring deep expertise in cloud-native data processing, analytics, and architecture, along with strong leadership capabilities to drive large-scale projects. Responsibilities:Design and implement end-to-end cloud data architectures us
Easy Apply
Posted 3 days ago

Data Engineer (W2 Only)

Ohm Systems, Inc

•

Remote

Contract

About the Role: We are seeking an experienced Data Engineer to join our Supply Chain Optimization team within the AIML (Artificial Intelligence & Machine Learning) division.This role is ideal for someone with a strong background in software engineering who is passionate about using data to drive operational excellence in supply chain processes.Minimum Qualifications 5+ years of experience in a software engineering or data engineering role.Proficiency in Python for data processing and automation.
Easy Apply
Posted 12 hours ago