Apache Spark Jobs in Virginia

Refine Results
461 - 480 of 527 Jobs

Agentic Data Engineer

DTEL Engineering & Consultants Inc

Richmond, Virginia, USA

Contract

Responsibilities: Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources. Ability to train and fine tune large language models Design and build the data architecture, including databases, data lakes to support various data engineering tasks. Develop and manage Extract, Load, transform (ELT) processes to ensure data is accurately and efficiently moved from source systems to analytical platforms used

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p

Palantir Foundry Developer / Data Engineer

GreyMatter Solutions

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp

Machine Learning Engineer (Infrastructure)

Photon

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras

Backend Software Engineer, ML

Bayside Solutions

Remote

Contract

Backend Software Engineer, ML W2 Contract Salary Range: $135,200 - $156,000 per year Location: Remote Role - PST Job Summary: As a Backend Software Engineer, you will work with the engineering team, EPM, and customers to support customer migration to next-generation services that generate, manage, and consume datasets, features, and embeddings used for ML training. You will utilize tooling to migrate data and work with customers to change their Python clients to start using the new SDK. Thi

Lead Confluent/Kafka Engineer

RapidIT, Inc

Remote

Third Party, Contract

Position: Lead Confluent/Kafka Engineer Fully Remote 6+ months Required: Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.5+ years of experience with Confluent Platform and Kafka, including experience in designing and implementing large-scale data streaming solutionsExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka r

Python Developer (FULL TIME)

VKore Solutions LLC

US

Full-time

Role: Senior Python Developer Location: REMOTE Mode of Hire: Full Time Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks. Experienced in MVW frameworks like Django, /Django and jQuery. Experienced in developing web-based applications using Python, Django, PHP, XML, CSS5, HTML, DHTML, JavaScript, RabbitMQ, Jdk1.7. Excellent Programming skills at a higher level of abstraction using Scala and Spark. Experience in pro

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami

MLOps Engineer

Ethires LLC

Remote

Contract

Job Title: MLOps Engineer Location: Bellevue, WA (Remote Work: 100%) Remote: Work: 100% Contract : 5+ Months Contract This is a high PRIORITY requisition. This is a PROACTIVE requisition Job Description: MLOps Engineer to work on AWS GovCloud DatabricksBachelor s degree in computer science, Engineering, Applied Mathematics or related field4-6 years of strong experience with AWS Gov Cloud environments / Export Control / FedRAMP environmentsOverall, 8-10 years of solid experience in the areas of d

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl

Data Scientist

BEAT LLC

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati

Agentic Data Engineer

Accylerate

Remote or Richmond, Virginia, USA

Full-time

Client: VDOT Title: Agentic Data Engineer Duration: 12 Months (Possible Extension) Location: Remote Note: Candidate needs to be in Richmond, VA, Once every Quarter Job Description: Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problemsThe Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI

SQL Developer - 12+ Yrs Exp - Healthcare Domain must - REMOTE - Minneapolis, MN

Cynosure Technologies LLC

Remote

Contract

Job - SQL Developer - 12+ Yrs Exp - Healthcare Domain must REMOTE - Minneapolis, MN Mandatory Skills - SQL Server, Azure Devops Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data mod

Platform Engineer with Scala@Sunnyvale,CA Remote

iBrain Technologies Inc.

Remote or Sunnyvale, California, USA

Third Party, Contract

Data Platform Engineer with Scala Location: Sunnyvale, CA/Remote Contract 12 Months Exp : 10+ Years Job Description: We are looking for highly skilled Data Infrastructure Engineers with strong expertise in distributed systems, API development, and software engineering. The ideal candidates should have hands-on experience building distributed applications in Scala and Kubernetes. Key Responsibilities: Develop and maintain a batch orchestration platform which runs 100,000+ jobs per day Develo

Agentic Data Engineer

Vector Consulting, Inc

Richmond, Virginia, USA

Contract

Our government client is looking for an Agentic Data Engineer on a hybrid 6+ months renewable contract role inRichmond, VA Position Agentic Data Engineer Job Description: Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The agency's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The

Machine Learning Engineer

Strategic Staffing Solutions

Virginia, USA

Full-time, Contract

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below. Beware of scams. S3 never asks for money during its onboarding process. Job Title: Machine Learning Engineer Contract: 7+ Months On Site Work Location: Mclean, VA Job ref# 241286 Requirements: Bachelor s degreeAt least 4 years of experience programming with Python, Scala, or J

Full Stack (Java/Python + React) - Remote - Fulltime

Lorven Technologies, Inc.

US

Full-time

Job Title:Full Stack (Java/Python + React) Location: Remote Employment Type: Fulltime Job description: UX prototyping contractors The Relevance team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make: Explore, shape, and develop new product experiences alongside engineers and product managers from the relevance team; from ideation to implementation Develop prototypes to iteratively validate ideas that push th

Confluent/Kafka Engineer

SGS Consulting

Remote

Full-time

Job Title Associate Confluent/Kafka Engineer Location Remote. Duration Contractual 06+ months ( Contact to hire opportunity) Note: Must complete the Associate Confluent/Kafka Engineer Assessment Responsibilities and Duties: Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications.Contribute to the development of new features and improvements to the existing platform.Develop and maintain integrations with various applications and systems using Kafka

Confluent/Kafka Engineer

Dew Softech Inc

Remote or Pittsburgh, Pennsylvania, USA

Full-time, Part-time, Third Party, Contract

Confluent/Kafka Engineer Location : Remote Duration: 6 Months (CTH) Job Description We are looking for a Confluent/Kafka Engineer for a contract-to-hire opportunity that is fully remote. What You'll Do Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications Contribute to the development of new features and improvements to the existing platform Develop and maintain integrations with various applications and systems using Kafka Connect Monitor a

AI/ML Architect

Ventures Unlimited

Remote or Pittsburgh, Pennsylvania, USA

Full-time

Job DescriptionMust Have Technical/Functional Skills 12+ years of experience in AI/ML engineering, including at least 3 years in an architectural role Extensive experience in AI/ML model development, deployment, and lifecycle management. Expertise in machine learning frameworks (TensorFlow, PyTorch, Scikit-learn) and cloud platforms (AWS, Google Cloud Platform, Azure). Strong programming skills in Python, Java, or C++ Proficiency in MLOps tools (Kubeflow, MLflow, Airflow, Docker, Kubernetes)