apache spark Jobs in virginia

Refine Results
361 - 380 of 424 Jobs

Data Bricks Engineer-W2 only

Gemini Consulting Services

•

Remote

Contract

Hello , Hope you are doing well. Please find the below job opportunities with our client. Role: Data Bricks Engineer-W2 only# of Openings: 5 Location: 100% remote Duration: 3-6 months; possible extensions Interview: 2 rounds: Offer Key Skills: Databricks, Python, Apache Spark, Scala, Airflow Experience with Medallion and Lakehouse architecture Databrick Certified is preferred. Job Description: - Need for Databricks engineers to handle data migration tasks. - Integration of Azure OpenAI Service
Easy Apply
Posted 3 days ago | Updated 3 days ago

Pyspark

New Era Technology

•

Remote

Contract, Third Party

Hi, Looking for PySpark Consultant, If you are interested in applying kindly share me your updated resume to Location: Remote Duration: 6+months Note : Palantir Foundry platform is must At least 7 years of experience working with large scale software systems. Proficient in PySpark, Python, SQL with atleast 5 years of experience Working experience in Palantir Foundry platform is must Experience designing and implementing data analytics solutions on enterprise data platforms and distributed com
Easy Apply
Posted 18 days ago | Updated 18 days ago

Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java

Buxton Consulting

•

Remote

Contract

Position: Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java Location: Remote (PST Timing) Duration: 12+ Months (May extend till 48 months) Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development 4-5 years of programming experience in Python, Java, Scala, and SQL is must. Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase. Strong experience with REST API development using Python fra
Easy Apply
Posted 25 days ago | Updated 2 days ago

Lead Big Data/Machine Learning Engineer

Strategic Staffing Solutions

•

Richmond, Virginia, USA

Full-time, Contract

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below. Beware of scams. S3 never asks for money during its onboarding process. Job Title: Lead Big Data/Machine Learning Engineer On Site Work Duration: 12+ months Locations: Richmond, VA Job ref# 242178 Required Qualifications: Python, Spark, SQL, AWS (Glue Batch - big files sets f
Easy Apply
Posted 6 days ago | Updated moments ago

Hiring for Data Scientist :: Remote

Feuji Inc

•

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop
Easy Apply
Posted 39 days ago | Updated 3 days ago

Data Architect with AWS, Databricks and Pyspark

E-Solutions, Inc.

•

California, USA

Full-time

Hi Professionals, Role Data Architect (Databricks) Duration: Fulltime Key Responsibilities: Solution Design & Implementation: Architecting and building scalable, secure, and high-performance data solutions on the Databricks platform using technologies like DLT Pipelines, Spark, Delta Lake, AI/BI Genie, etc. Data Pipeline Development: Designing and implementing end-to-end data pipelines, including ETL/ELT processes, for both batch and real-time data processing. Data Governance & Security: Defini
Easy Apply
Posted 3 days ago | Updated 2 days ago

Lead Azure Data Engineer(15 + Years Exp. Required)

GSPANN Technologies

•

Remote or Fremont, California, USA

Contract

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a
Easy Apply
Posted 12 days ago | Updated 11 days ago

Azure Data Solution Architect

RNR IT Solutions, Inc.

•

Remote or Little Elm, Texas, USA

Full-time

Job Title: Data Warehouse & Azure Data Architect / Principal Data Engineer Location: Remote 15+ years of experience in database architecture, data engineering, and analytics solutionsStrong expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft FabricProficient in Python, Spark SQL, T-SQL, and metadata-driven developmentExperience designing and implementing Data Vault 2.0,
Easy Apply
Posted 17 days ago | Updated 3 days ago

Resident Solution Architect

Cycle 3 IT Staffing

•

Remote

Contract

Cycle3 IT Staffing is seeking several Resident Solutions Architects who are SENIOR LEVEL for a REMOTE role. Architecting and Leadership: o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh. Data Engineering: o Strong programming experience in Python; Scala is a significant plus. o Proficiency in complex query tuning. o Experience building Slowly Changing Dimensions (SCD) TYPEs. o Familiarity with DBT. o Experience with structured streaming
Easy Apply
Posted 5 days ago

Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Key Responsibilities: Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure) Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc. Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGaps Optimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environments Collaborate with sales teams to understand client needs and
Easy Apply
Posted 9 days ago

Databricks Engineer

Oscar Technology

•

Remote

Full-time

Job Title: Databricks Engineer - Remote Location: Remote Job Type: Full-Time Experience Level: Mid to Senior (5+ years) About the Role: We are seeking a skilled and experienced Databricks Engineer with a strong background in both Azure and AWS cloud platforms. As a key member of our Data Engineering team, you will design, develop, and optimize scalable data solutions using Apache Spark on Databricks, enabling advanced analytics and data-driven decision-making across the organization. This is
Easy Apply
Posted 9 days ago | Updated 2 hours ago

Databricks Engineer

Xyant Services, Inc.

•

Remote

Contract

Lead Databricks Engineer Role SummaryArchitecture & Engineering Leadership:Leads the end-to-end architecture, design, and implementation of big data pipelines on Databricks Lakehouse Platform, integrating with Azure, AWS, or Google Cloud Platform. Data Pipeline & ETL Expertise:Develops scalable, high-performance ETL/ELT pipelines using PySpark, Delta Lake, and SQL, enabling real-time and batch processing of large datasets. Team & Project Oversight:Mentors junior engineers, drives Agile delivery,
Easy Apply
Posted 2 days ago

Data Engineer

7hillsTS

•

Remote

Contract, Third Party

Job Title: Data Engineer Location: Remote Experience: 6+ years Job Description: We are seeking a skilled Data Engineer to build and optimize data pipelines and architectures for analytics and operational use. The ideal candidate will be experienced in data integration, transformation, and modeling using modern big data and cloud technologies. Key Responsibilities: Design, build, and maintain scalable data pipelines.Develop ETL/ELT processes to ingest data from various sources.Work with structur
Posted 3 days ago

ML Ops Engineer (AWS GovCloud Databricks) - Remote - W2 only

Saksoft

•

Remote

Contract

Position: ML Ops Engineer (AWS GovCloud Databricks) Duration: 12+ months contract Location: Charlotte, NC (100% remote) JOB DESCRIPTION SKILLS NEEDED : Bachelor's degree in computer science, Engineering, Applied Mathematics or related field4 to 6 years of strong experience with AWS Gov Cloud environments, Export Control FedRAMP environmentsOverall 8 to 10 years of solid experience in the areas of data engineering, machine learning data science4 to 6 years of strong experience with the following
Easy Apply
Posted 2 days ago

Program Manager

Tektend llc

•

Remote or New York, New York, USA

Third Party, Contract

Job Title: Program Manager Location: Remote Duration: 12+ Months Key Skills & Qualifications: Experience: 7+ years of experience in program management, with at least 3-5 years focused on digital transformation, cloud data platforms, and data analytics initiatives. Expertise in Databricks: Strong hands-on experience with Databricks platform, including but not limited to data engineering, machine learning workflows, and data science pipelines. Data Analytics: Solid understanding of data analytics
Posted 15 days ago | Updated 8 hours ago

Cloud Engineer Senior (1) Informatica

Sun Radia

•

McLean, Virginia, USA

Part-time

Cloud Engineer Senior (1) Informatica JD - Required Skills: Strong Hands-on experience with ETL and Data Integration tools, including Informatica PowerCenter, IICS and IDMC Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM Proficient in Python, Spark, Java and/or Scala programming languages Experience with development on AWS and cloud native applications Experience with Linux, shell scripting and the full ELK
Easy Apply
Posted 19 days ago

Java Developer with MongoDB

Accuro Group

•

McLean, Virginia, USA

Third Party

Note: We are looking for Local Candidates of McLean, VA & Plano, TX Design, develop, and maintain scalable and high-performance Java-based applications with a focus on data-intensive processes. Work extensively with MongoDB and other NoSQL databases to manage and optimize data storage and retrieval. Collaborate with cross-functional teams to architect solutions leveraging AWS services such as S3, Lambda, EC2, RDS, etc. Implement and maintain data pipelines and streaming solutions using tools li
Easy Apply
Posted 53 days ago | Updated 2 days ago

asp.net developer

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 218,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version
Easy Apply
Posted 25 days ago

Full Stack Developer - REMOTE

Contract Staffing Recruiters

•

Remote

Contract

The Opportunity: We are seeking a full stack engineer/developer with experience in projects emphasizing big data and application migration. This person will be responsible for supporting our customers migration of hundreds of applications to Databricks including authentication, rewiring of connections, building new libraries, and adapting notebooks and code. Work with the Business Intelligence team and operational stakeholders to design and implement migration strategy of read only and transact
Easy Apply
Posted 5 days ago | Updated 5 days ago

Data Infrastructure Engineer

Bayside Solutions

•

Remote

Contract

Data Infrastructure Engineer W2 Contract Salary Range: $124,800 - $145,600 per year Location: Remote Role - PST Job Summary: We require a Data Infrastructure Engineer with strong expertise in distributed systems, API development, and software engineering. This role requires hands-on experience building distributed applications in Scala and Kubernetes. Duties and Responsibilities: Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day Develop migration tooling t
Easy Apply
Posted 9 days ago | Updated 2 hours ago