Apache Spark Jobs in Virginia

Refine Results
1 - 20 of 452 Jobs

Big Data/Spark Principal Architect

Anagha Techno Soft

•

Remote

Full-time

Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation. Job Description: Hands on with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data operations.
Easy Apply
Posted 1 day ago

Big Data/Spark Principal Architect

TIU Consulting

•

Remote

Full-time

Hello Professionals, We are looking for Big Data/Spark Principal Architect with the following skill sets. Big Data/Spark Principal Architect | Location: Remote Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Job Description Hands-on with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology.Good learning & cross skilling ability.Design & Architectur
Easy Apply
Posted 1 day ago

Data Engineer (Databricks & Spark Specialist)

Harmonia Holdings Group, LLC.

•

McLean, Virginia, USA

Full-time

Harmonia Holdings Group, LLC is an award-winning, rapidly growing federal government contractor committed to providing innovative, high-performing solutions to our government clients and focused on fostering a workplace that encourages growth, initiative, creativity, and employee satisfaction. This role involves designing, building, and maintaining scalable data pipelines using Apache Spark and Databricks. The Data Engineer will work with cloud platforms like Azure or AWS, handling data ingestio
Posted 8 days ago | Updated 8 hours ago

Data Engineer (Spark/Scala/Python)

XTGlobal

•

Virginia, USA

Contract

Data Engineer * Hybrid in Richmond Only W2 consultants. 5+ years of experience in at least one of the following: Java, Scala, Python/PySpark, SQL or Go 3+ years of experience with AWS, specifically EMR 3+ years of experience in open source frameworks Experience building high-volume data interactions and observability/monitoring tools will be a huge plus Required Skills : Spark Python, Java, or Scala EMR SQL MQ experience (Kafka, Kinesis, etc.) Please share resumes to
Easy Apply
Posted 60+ days ago | Updated 13 hours ago

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

•

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Data Scientist

Zillion Technologies

•

McLean, Virginia, USA

Contract

THIS ROLE IS NOT OPEN FOR SPONSORED CANDIDATES THIS ROLE IS FOR A DIRECT CLIENT CANDIDATES WITHIN 25 MILES FROM MCLEAN, VA ARE ENCOURAGED TO APPLY THIS ROLE REQUIRES THE DATA SCIENTIST TO BE ONSITE (HYBRID), 3 DAYS A WEEK Data Scientist Duration: 6 months. Opportunity to convert to Full Time. Location: Onsite (Hybrid) in McLean, VA on Tuesday, Wednesday and Thursday Schedule: Standard Years of experience: 5 7 years of experience Must Have Qualifications: Strong understanding of SDLC, Python, Py
Easy Apply
Posted 1 day ago

Lead Agentic Data Engineer

Cynet Systems

•

Richmond, Virginia, USA

Contract, Third Party

We are looking for Lead Agentic Data Engineer for our client in Richmond, VA Job Title: Lead Agentic Data Engineer Job Location: Richmond, VA Job Type: Contract Job Description: Responsibilities:Guiding and mentoring AI engineers, helping them develop their skills and knowledge in the field.Leading and managing AI projects, ensuring they stay on track, meet deadlines, and the findings are actionable and relevant. Contributing to the creation and implementation of AI strategies that align with t
Easy Apply
Posted 2 days ago | Updated 1 day ago

Sr Big Data Engineer

ApTask

•

Remote

Full-time

We are looking for a proficient Senior BigData Engineer to join our team to work on exciting opportunities. Essential Functions: Help support Data Replication Service (Spark jobs) and develop features/bug fixes.Help port Data Copy Service (DCS) features into DRS.Help support SparkCp (a library) in debugging and fixing issues encountered by DRS.Help support the CDH Migration Tool in debugging and fixing issues encountered by customers.Implement monitoring/alerting improvements to the 3 tools men
Easy Apply
Posted 24 days ago | Updated 24 days ago

Provider Architect

Abhyanth Solutions

•

Remote

Third Party, Contract

Role: Provider Architect Years of Experience: 13+ years Location: Remote Job Description: We are seeking an experienced Provider Architect to lead the design, development, and deployment of innovative, scalable, and secure solutions within the healthcare provider domain.The ideal candidate will have a strong background in cloud-native application development, Neo4j Graph DB, REST APIs, and experience with Spark and Medallion Architecture.This role involves collaborating with cross-functional tea
Easy Apply
Posted 2 days ago | Updated 2 days ago

Agentic Data Engineer

Canopy One Solutions Inc

•

Richmond, Virginia, USA

Third Party, Contract

Agentic Data Engineer 1401 E Broad St Richmond, VA 23219 - Hybrid Both Phone and In Person Interview Short Description: Resource will need to be in Richmond, VA quarterly. Position is expected to be needed through 12.31.2025. Complete Description: Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The client is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage ag
Easy Apply
Posted 22 hours ago

Azure Data Visualization Engineer

Solution Partners, Inc.

•

Remote

Contract

We have a client in Chicago searching for a Data Engineer/Data Visualization Consultant that has experience with Power BI, Azure Synapse, Apache Spark and Power Query. The project requires a balance of Data Engineering/Data Visualization (ideal split would be 40% Engineering; 60% Power BI/Data Visualization). We need someone for 7 weeks of work. Project Details: Right now, they have 3 Azure databases and 1 is going away that will be replaced with REST API and they use Dropbox that has 150 files
Easy Apply
Posted 4 days ago

Sr Data Engineer

Teknosys Inc

•

Remote

Contract

Job Title: Sr. Data Engineer Experience : 8 to 10 years Location: Must be onshore (US) Job Description: Remote (for California based team) What you ll do: As a Senior Data Engineer, you ll be responsible for building high performance, scalable data solutions that meet the needs of millions of agents, brokers, home buyers, and sellers. You ll design, develop, and test robust, scalable data platform components. You ll work with a variety of teams and individuals, including product engineers to un
Easy Apply
Posted 1 day ago

Artificial Intelligence Engineer

Torc

•

Remote

Contract

AI Engineer - Remote We re looking for a skilled AI Engineer for a full-time contract. This is a remote role with the flexibility to collaborate across all hours in Central Time (CT). What You ll Do Develop and Deploy AI Solutions: Build and maintain robust machine learning pipelines using frameworks like TensorFlow, PyTorch, and Scikit-Learn.Data Integration: Work with data engineers to integrate large-scale datasets into efficient AI workflows.Model Optimization: Fine-tune models for performan
Posted 12 days ago

Google Cloud Platform Data Solutions Architect

MOONITSolutions Inc.

•

Remote

Contract

Create Solution designs for large-scale data structures and pipelines to organize, collecting and standardizing data that helps generate insights and addresses business and reporting needsProvision cloud resources, including tenants, Cloud Storage buckets, datasets, and service accounts.Expertise in Google Cloud Platform (Google Cloud Platform), including BigQuery, Cloud Composer, Dataproc, and Dataflow.Implement DevOps and MLOps practices to streamline machine learning model deployment and data
Easy Apply
Posted 4 days ago

Lead Agentic Data Engineer

TriosysIT Inc.

•

Richmond, Virginia, USA

Third Party, Contract

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. Client is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction between agents and data. Responsibilities: Guiding and mentoring AI en
Easy Apply
Posted 2 days ago

Data Scientist::Hartford CT

VLink Inc

•

Remote

Contract

About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients. Role: Data Scientist Location: Remote / Hartford CT Duration: 12 Months Job Description: P&C Insurance Experience is MUST (Prefer candidates with Claim related/domain Experience) Database - Snowflake Python Spark
Easy Apply
Posted 5 days ago | Updated 3 days ago

Data Engineer - Remote (Offshore - Remote India)

FlairTech Solutions

•

Remote

Contract

Role: Data Engineer Location: Remote Duration: Long Term Experience: Bachelor s degree in computer science, Engineering, or a related field 5+ years experience in data engineering, ELT development, and data modeling. Proficiency in using Apache Airflow and Spark for data transformation, data integration, and data management. Experience implementing workflow orchestration using tools like Apache Airflow, SSIS or similar platforms. Demonstrated experience in developing custom connectors for dat
Easy Apply
Posted 1 day ago

Google Cloud Platform Data Engineer - Healthcare (Citizens only)

People Force Consulting Inc

•

Remote

Contract

CITIZENS ARE ENCOURAGED TO APPLY ONLY As an Google Cloud Platform Data Engineer, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards . Responsibilities: - Takes a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects.Utili
Easy Apply
Posted 9 days ago | Updated 1 day ago

Senior Data Scientist with Data Engineering Experience

Pyramid Consulting, Inc.

•

McLean, Virginia, USA

Contract

Immediate need for a talented Senior Data Scientist with Data Engineering Experience. This is a 06+months contract opportunity with long-term potential and is located in McLean, VA (Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID: 25-62165 Pay Range: $65 - $75/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities:
Easy Apply
Posted 8 days ago

Big Data Analyst

Market Street Talent

•

Remote or Westbrook, Maine, USA

Contract

Could you be a good fit? We are looking for the best, highly skilled Big Data Analyst to join the team of our exceptional client located in the greater Portland area. This role can be fully remote, although local candidates will be given priority. Benefits: RemoteHealthcare Medical including HSADental and Vision Insurance401kWhat will your day look like? As a Big Data Statistical Analyst you will: Act as a trusted advisor and collaborative partner with external and internal customers, providing
Easy Apply
Posted 16 days ago