apache spark Jobs in virginia

Refine Results
21 - 40 of 677 Jobs

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 6 days ago | Updated 4 hours ago

Azure Databricks Engineer

Aptino

•

Remote

Contract, Third Party

Job Description: We are seeking a skilled Platform Engineer with strong expertise in Azure, Databricks, and Snowflake. The ideal candidate will be responsible for configuring and maintaining platform components, ensuring governance alignment, optimizing performance, and evaluating new platform features to support data engineering and analytics initiatives. Key Responsibilities: Align platform configurations with data governance and compliance standards. Evaluate and implement enhancements and ne
Easy Apply
Posted 8 days ago | Updated 9 hours ago

Sr. Hadoop Developer

eGrove Systems Corporation

•

Remote

Contract

Job Description - Need candidate on PV's W2 Sr. Hadoop Developer End Client: GuideWell Location: Remote (work EST hours) Duration: 12 months Job Title: Sr. Hadoop Developer Candidate Requirements. 5-7 years overall IT development skills3+ years of Spark and Scala professional experience in a Lead Developer role (design & scaling technology)Strong cross-collaboration with different departments/teams requiredApache/Kafka & DB2 experience required Healthcare exp. RequiredExperience with Hybrid
Easy Apply
Posted 1 day ago

ETL Data Engineer

Innova Solutions, Inc

•

Reston, Virginia, USA

Contract

Innova Solutions has a client that is immediately hiring for IT Engineer V (ETL Data Engineer) Position type: Full Time, Contract Duration: 5 Months Location: Reston, VA (3 days/week Hybrid Onsite) As an IT Engineer V, you will be responsible for Ability to run the CDI-PC assessment and interpret the flags for IDMC conversion.Experience automating repetitive tasks related to provisioning of AWS Services, installation, configuration, or management of infrastructure using Terraform, Gitlab, Ansi
Easy Apply
Posted 26 days ago

Big Data Engineer

Infoway Software

•

Richmond, Virginia, USA

Contract

Must sit onsite in Richmond, VA hybrid Title- Big Data Engineer Python, Spark, SQL, AWS (Glue Batch - big files sets from 3rd party partner and use real-time API to get the data to make accessible to internal system
Easy Apply
Posted 6 days ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 12 days ago

Staff Data Scientist -- Direct Hire -- REMOTE Position (& Citizens ONLY)

Amtex Enterprises

•

Remote

Full-time

Staff Data Scientist Location: Remote- CST time working hours Salary: DOE QUALIFICATIONS: Master's or PhD degree in a machine learning/AI related field such as engineering, statistics, computer science, or physics 5+ years of industry experience in data science, data analytics, and machine learning in advertising domain Extensive experience in Real-Time Bidding (RTB) systems. Skilled in applying advanced data science methodologies to improve the efficiency, profitability, and competitiveness o
Easy Apply
Posted 14 days ago

Databricks Engineer

Showman Staffing

•

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Desig
Easy Apply
Posted 1 day ago

Java / Databricks Engineer

Sriven Systems Inc.

•

Remote

Contract

Java / Databricks Engineer 2 year project (remote) Workstream - Platform Convergence Role Summary: Development, Unit Testing , Functional testing towards intent related to Platform Convergence Workstream. Knowledge and Skills Experience working on building Applications, testing and deploying to cloud (Python, Java, Spark. Typescript)Experience building data pipelines and deploying them to cloudExperience with public cloud environments (AWS+, Azure, Google Cloud Platform)Experience working with
Easy Apply
Posted 1 day ago

Big Data Hadoop Engineer

Harvey Nash Inc.

•

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API
Easy Apply
Posted 28 days ago | Updated 21 days ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 13 hours ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 6 days ago

Python Developer - W2 - Hybrid in McLean, VA or Richmond, VA (Need Locals)

Saksoft

•

McLean, Virginia, USA

Contract

Title - Python Developer Location: Hybrid in McLean, VA or Richmond, VA Duration: 12-month contract Interview Process: 1 round, 1 hour, 2nd round only if needed Must have previous Capital One Experience Required: -5-7+ years experience - Python (primary) and Java (secondary) - AWS: Lambda, ECS, EC2, Faregate - Kafka or Kinesis - Node.js - DynamoDB - RESTful APIs - Experience building data pipelines (Spark experience preferred) - Familiarity with performance testing is a plus
Easy Apply
Posted 12 hours ago | Updated 10 hours ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 5 days ago | Updated 12 hours ago

Databricks Solution Architect

Innova Solutions, Inc

•

Remote

Full-time

A client of Innova Solutions is looking for a Databricks Solution Architect Position Type: Full-Time Location: Remote Industry: Healthcare As a Databricks Solution Architect, you will: Minimum Qualifications: We are looking for an experienced Databricks Solution Architect to join our team and lead the design, development, and optimization of scalable data and analytics solutions on the Databricks platform. You will play a key role in architecting cloud-native data pipelines, enabling advanced an
Easy Apply
Posted 46 days ago | Updated 14 days ago

Senior Cloud Engineer - Dremio

Sun Radia

•

McLean, Virginia, USA

Contract

Senior Cloud Engineer - Dremio McLean, VA 12 Months Contract Face to Face Interview Required Skills: Dremio application management with one year or more experience is a must have. Strong hands on experience building ETL pipelines using Apache Spark. Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM. Proficient in Python and/or Scala programming languages Knowledge of application development lifecycles, & cont
Easy Apply
Posted 1 day ago

Machine Learning Engineer, Core Engineering

Pinterest, Inc.

•

Remote or San Francisco, California, USA

Full-time

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility
Posted 50 days ago | Updated 9 hours ago

SR DATA REPORTING ANALYST

3Core Systems, Inc

•

Remote

Contract

3Core Systems, Inc is an SAP and Success Factors Partner with employees located across the United States. Our organization is dedicated to customer and employee satisfaction. We provide High Quality, Cost efficient and Competitive Solutions and Resources. 3Core Systems is looking for SR DATA REPORTING ANALYST for one of our clients in Remote TITLE: SR DATA REPORTING ANALYST LOCATION: REMOTE DURATION: 12+ MONTHS Project Overview The team is decommissioning the mainframe and transitioning to Alpha
Easy Apply
Posted 5 days ago | Updated 16 hours ago

Director, Software Engineering

Salesforce

•

Remote or San Francisco, California, USA

Full-time

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving you
Posted 5 days ago | Updated 9 hours ago

Data Engineer

AaraTechnologies Inc

•

Remote or Virginia City, Nevada, USA

Contract

Data Engineer (3 4 Years Experience) Experience Level: Mid-level (3 4 years) Company: Aaratech Inc Eligibility: Open to U.S. Citizens and s only. We do not offer visa sponsorship. About Aaratech Inc Aaratech Inc is a specialized IT consulting and staffing company that places elite engineering talent into high-impact roles at leading U.S. organizations. We focus on modern technologies across cloud, data, and software disciplines. Our client engagements offer long-term stability, competitive comp
Easy Apply
Posted 8 hours ago