Apache Spark Jobs in Virginia

Refine Results
441 - 460 of 524 Jobs

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Full Stack Engineer(Java)-Data Modeling - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

Citi: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemically r

Sr. Application Developer (Data Mastering) - Remote

Lincoln Financial Group

Remote or Radnor, Pennsylvania, USA

Full-time

Alternate Locations: Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Greensboro, NC (North Carolina); Radnor, PA (Pennsylvania) Work Arrangement: Hybrid Preferred : Preferred employee will work 3 days a week in a Lincoln office Relocation assistance: is not available for this opportunity. Requisition #: 73942 The Role at a Glance The person in this role will be responsible for designing, developing, and implementing Master Data Management solutions. It involves working closely wit

Data Engineer

Mindlance

Richmond, Virginia, USA

Contract, Third Party

Title: Sr. Data Engineer Location: Richmond, VA (Hybrid) - 3 days onsite Duration: 6 months (Possible extension) Position Overview: 9+ years of experience in application development including Python, SQL, Scala, and Java 4+ years of experience with a public AWS cloud 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of data warehousing experience

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

Lead Data Engineer with Data platforms

Techim INC

Remote

Contract

Hi, Greetings of the day! Lead Data Engineer-Data Platforms-Azure REMOTE Required skills: "Design and implement scalable data pipelines and architectures on Azure Databricks. Optimize ETL/ELT workflows, ensuring efficiency in data processing, storage, and retrieval. Leverage Apache Spark, Delta Lake, and Azure-native services to build high-performance data solutions. Ensure best practices in data governance, security, and compliance within Azure environments. Troubleshoot and fine-tune Spar

Data Engineer

Charter Solutions Inc.

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API

MLOps Architect (Databricks Specialist)

Amiseq Inc.

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know

Triage Engineer

Stanley David and Associates

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr

Machine Learning AI Engineer

Buxton Consulting

Remote

Contract

Position: Machine Learning AI Engineer Duration: 12+ Months Location: Remote Must Haves Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API

Big Data Developer

URSI Technologies Inc.

Remote

Third Party, Contract

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr

Full stack Engineer

Prism IT Corp

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex

Azure Data Engineer Consultant

Korn Ferry

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows

Data Engineer Machine Learning

Calsoft Labs

Richmond, Virginia, USA

Third Party, Contract

Position: Data Engineer Machine Learning Location: Richmond, VA 23219 Duration: 6 Months contract Job Description: Responsibilities: Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources.Ability to train and fine tune large language modelsDesign and build the data architecture, including databases, data lakes to support various data engineering tasks.Develop and manage Extract, Load, transform (ELT

Data Engineer

Dahl Consulting

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,

Confluent/Kafka Developer

Advanced Technology Group, Inc

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong

Agentic AI Data Engineer@Richmond, VA F2F

iBrain Technologies Inc.

Richmond, Virginia, USA

Third Party, Contract

Agentic AI Data Engineer Richmond, VA Hybrid & F2F Interview 12 Months Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems Experience training LLMs with structured and unstructured data sets highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems,

VDOT - Agentic Data Engineer

Inteliblue LLC

Remote or Richmond, Virginia, USA

Contract

Data Engineer- Immediate placement This is a very urgent requirement with immediate placement, please apply for immediate consideration. No H1b, No Sponsorship, And No C2C - only W2 or 1099 candidates Urgent Need -- - Required Locals (Richmond, Virginia) Job Title: Data Engineer Location: Richmond, Virginia Interview: Phone /In-Person Duration: Long Term Job description: Required Skills: Strong data engineering fundamentals. Experience with Big Data frameworks (Spark, Databricks). Prof

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p

Google Cloud Platform Architect

Estuate Inc.

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected