apache spark Jobs in virginia

Refine Results
21 - 40 of 428 Jobs

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 15 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 21 days ago

Senior/Lead Data Engineer , Remote, $63/HR

FASTRA LLC

•

Remote

Contract

Job Title: Senior/Lead Data Engineer Location: Remote Duration: 12 Months Responsibilities: Collaborate with cross-functional stakeholders (including data scientists, analysts, and business teams) to define data requirements, processing needs, and analytics solutions.Create and sustain scalable data models and efficient extraction processes.Establish and monitor data quality checks and validation systems.Construct and enhance business intelligence dashboards.Produce comprehensive documentation f
Easy Apply
Posted moments ago | Updated moments ago

Python Developer - W2 - Hybrid in McLean, VA or Richmond, VA (Need Locals)

Saksoft

•

McLean, Virginia, USA

Contract

Title - Python Developer Location: Hybrid in McLean, VA or Richmond, VA Duration: 12-month contract Interview Process: 1 round, 1 hour, 2nd round only if needed Must have previous Capital One Experience Required: -5-7+ years experience - Python (primary) and Java (secondary) - AWS: Lambda, ECS, EC2, Faregate - Kafka or Kinesis - Node.js - DynamoDB - RESTful APIs - Experience building data pipelines (Spark experience preferred) - Familiarity with performance testing is a plus
Easy Apply
Posted 15 days ago | Updated 14 days ago

Artificial Intelligence Engineer

cyberThink, Inc.

•

Richmond, Virginia, USA

Contract, Third Party

Position: Artificial Intelligence Engineer (Richmond, VA - quarterly on-site) Key Requirements: 10+ years of experience leading data science projects and teams Advanced proficiency in Python/R, SQL databases, and Big Data frameworks like Spark/Databricks 4+ years of experience in machine learning, including training large language models (LLMs) with structured and unstructured data 5+ peer-reviewed publications demonstrating strong research and analytical skills Excellent communication abilities
Easy Apply
Posted 7 days ago | Updated 5 days ago

767067 - Agentic Engineer

Maisters Recruiting

•

Richmond, Virginia, USA

Contract

Role : Agentic Engineer The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Engineer to design, develop that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems. ensure data quality and facilitating interaction between agents and data. ResponsibilitiesDesign and develop data pipelines for agentic systems; develop robust data flows to handle complex interactions betwee
Easy Apply
Posted 6 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 14 days ago

Sr Agentic Engineer

Dia Software Solutions

•

Richmond, Virginia, USA

Third Party, Contract

Hi, Greetings from DIA SOFTWARE SOLUTIONS LLC! We reaching out about an exciting Direct client opportunity with one of our clients. Please review the requirements and let me know if you are interested in this position? Direct client Req:: Need Sr Agentic Engineer VA, Hybrid PLEASE SEND THE RESUMES TO SKUMAR AT DIASOFTWARESOLUTIONS DOT COM ! Job Description: Responsibilities Design and develop data pipelines for agentic systems; develop robust data flows to handle complex interactions between AI
Easy Apply
Posted 4 hours ago

Data Engineer(Top Secret Clearance)

Navitas Business Consulting Inc

•

Herndon, Virginia, USA

Full-time

Mid-level Data Engineer Top Secret Clearance required Federal requirement. Required Education: Bachelor s degree plus 5-7 years experience, or a Masters Degree plus 3 years of experience.Required Skills/Experience: Experience with Big Data systems, including Apache Spark / DatabricksExperience with ETL processes;Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0;Applying DoD Security Technical Implementation Guides (STIGs) and automating that processExperience with multi
Easy Apply
Posted 9 days ago | Updated 1 hour ago

Machine Learning Engineer | Only W2

TekDallas

•

Remote

Contract

Position: Machine Learning Engineer Location: 100% Remote (EST time zone) Duration: 12 Month Contract Only W2 Qualifications: 10+ years of IT experience and at least 5+ years working as a Machine Learning EngineerMust have strong programming skills in PythonExperience with both RDBMS and NoSQL databases (e.g., MongoDB, BigQuery)Hands-on experience with data preprocessing, feature engineering, and model evaluationExperience working with cloud platforms, especially Google Cloud Platform (Googl
Easy Apply
Posted 7 days ago | Updated 1 day ago

AI/ML Engineer

Innosoul inc

•

Richmond, Virginia, USA

Contract, Third Party

Job ID: VA-766844 Hybrid/Local AI/ML Engineer (Agentic Data/15+) with data science, supervised/unsupervised learning, model selection, feature engineering, SQL Server, Spark/Big Data, GraphDB, Azure Databricks, Python/R, LLMs, Git and GIS spatial data experience Location: Richmond, VA (VDOT)Duration: 5 MonthsPosition: 1(2) Skills:Advanced proficiency in Python and/or R Required 10 YearsKnowledge of SQL Databases Required 10 YearsExperience with Spark, GraphDB, Azure Databricks Required 5 YearsEx
Easy Apply
Posted 8 days ago

AIOps Google Cloud Platform Engineer - W2

DynPro Inc.

•

Remote

Contract

ONLY W2 Role: AIOps Google Cloud Platform Engineer Location: Remote, USA Duration: 12-month contract About the Role: Google Cloud is at the forefront of innovation, empowering businesses with cutting-edge cloud technologies. As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimi
Easy Apply
Posted 20 days ago | Updated 5 days ago

AI/ML Engineer

Universal Business Consulting

•

Remote

Contract

Contract- 12 Months We are seeking an experienced data scientist with expertise in AIOps and IT Operations to spearhead our Event Management Program. The ideal candidate will possess a deep understanding of data analytics, machine learning algorithms, and IT operations to help automate and optimize our event correlation and incident response systems. What Our AIOps Team Does: We integrate data from various monitoring platforms to achieve a comprehensive view of our IT environment.We harness the
Easy Apply
Posted 9 days ago | Updated 6 days ago

Data Engineering Manager - Security

Netflix, Inc.

•

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Securing our members' data and accounts appropriately is key to maintaining a high level of trust with our customers. In addition, securing our technology infrastructur
Posted 11 days ago | Updated 9 hours ago

Data Engineer

Eliassen Group

•

Anywhere, US

Contract

Description: We're looking for two skilled Senior Data Engineers to join a high-impact project migrating workloads from a Hadoop On-Prem cluster to Google Cloud Platform (Google Cloud Platform). We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $65 - $75 / hr. w2 Responsibilities: Build Spark/BigQuery data pipelines on Google Clo
Posted 8 days ago | Updated 10 hours ago

Databricks Solution Architect

Innova Solutions, Inc

•

Remote

Full-time

A client of Innova Solutions is looking for a Databricks Solution Architect Position Type: Full-Time Location: Remote Industry: Healthcare As a Databricks Solution Architect, you will: Minimum Qualifications: We are looking for an experienced Databricks Solution Architect to join our team and lead the design, development, and optimization of scalable data and analytics solutions on the Databricks platform. You will play a key role in architecting cloud-native data pipelines, enabling advanced an
Easy Apply
Posted 60+ days ago | Updated 29 days ago

Data Engineering Manager - Member Innovation

Netflix, Inc.

•

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We are looking for an experienced leader to help lead the Member Innovation Data Engineering team. This team will work in close partnership with Data Scientists and Pro
Posted 2 days ago | Updated 9 hours ago

Software Engineer

Kforce Technology Staffing

•

Remote or Brooklyn, New York, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Software Engineer in Brooklyn, NY. Summary: Join a high-impact team focused on enhancing ad targeting and optimizing campaign performance. In this role, you will build scalable, high-performance software that integrates with marketing systems to enable data-driven decisions. Key Responsibilities: * Software Engineer will design and maintain software for marketing channels, customer data platforms, and data privacy * Develop APIs and servi
Posted 5 days ago | Updated 2 hours ago

Data Platform Engineer

Infojini

•

District of Columbia, USA

Contract, Third Party

Special Skill set: 6+ years of experience in data engineering, real-time streaming, or event-driven architectures. Strong hands-on expertise in Amazon MSK (Managed Streaming for Apache Kafka), Kafka Streams, and Kafka Connect. Experience in managing data flows with Apache NiFi and workflow orchestration with Apache Airflow. Proficiency in managing MQ and other Pub/Sub messaging platforms and frameworks. Experience with Flink, Spark Streaming, or similar frameworks for real-time processin
Easy Apply
Posted 5 hours ago | Updated moments ago

Staff Data Scientist, Curation Ecosystem

Pinterest, Inc.

•

Remote or San Francisco, California, USA

Full-time

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility
Posted 4 days ago | Updated 10 hours ago