Apache Spark Jobs

Refine Results
1,981 - 2,000 of 2,192 Jobs

Artificial Intelligence Engineer - Agentic Data Engineer

V-Soft Consulting Group, Inc

Richmond, Virginia, USA

Contract

Artificial Intelligence Engineer - Agentic Data Engineer Primary Location: Richmond, Virginia Hybrid position V-Soft Consulting is currently hiring for an Artificial Intelligence Engineer - Agentic Data Engineer for our premier client in Richmond, Virginia. Education and Experience Degree in Computer Science, AI, Data Science, or a related field. Ph.D. in a STEM field (Natural sciences, Computer Science, Statistics). 10+ years of leading data science projects or teams. Experience mentoring or

ML Ops Engineer (AWS GovCloud Databricks) - Remote - W2 only

Saksoft

Remote

Contract

Position: ML Ops Engineer (AWS GovCloud Databricks) Duration: 12+ months contract Location: Charlotte, NC (100% remote) JOB DESCRIPTION SKILLS NEEDED : Bachelor's degree in computer science, Engineering, Applied Mathematics or related field4 to 6 years of strong experience with AWS Gov Cloud environments, Export Control FedRAMP environmentsOverall 8 to 10 years of solid experience in the areas of data engineering, machine learning data science4 to 6 years of strong experience with the following

Apache NiFi Developer

VDart, Inc.

Bellevue, Washington, USA

Contract, Third Party

Job Title: Apache NiFi Developer Location: Bellevue, WA Duration: / Term: 6+ months Job Description: Experience Desired: 5+ Years. Design, develop, and optimize data ingestion and processing workflows using Apache NiFi. Configure and manage NiFi processors, controller services, and data provenance features. Integrate NiFi with other systems (e.g., Kafka, Hadoop, S3, RDBMS, APIs). Ensure data quality, reliability, and security in flow pipelines. Maintain and update existing NiFi data pipeli

Program Manager

Tektend llc

Remote or New York, New York, USA

Third Party, Contract

Job Title: Program Manager Location: Remote Duration: 12+ Months Key Skills & Qualifications: Experience: 7+ years of experience in program management, with at least 3-5 years focused on digital transformation, cloud data platforms, and data analytics initiatives. Expertise in Databricks: Strong hands-on experience with Databricks platform, including but not limited to data engineering, machine learning workflows, and data science pipelines. Data Analytics: Solid understanding of data analytics

AI/ML Engineer with 12+ years (day 1 onsite)

M3BI, LLC.

Phoenix, Arizona, USA

Contract, Third Party

Overall experience of at least 12+ years is needed Design and implement scalable MLOps supportive data pipelines for data ingestion, processing, and storage. Experience deploying models with MLOps tools such as Vertex Pipelines, Kubeflow, or similar platforms. Experience implementing and supporting end-to-end Machine Learning workflows and patterns. Expert level programming skills in Python and experience with Data Science and ML packages and frameworks. Proficiency with containerization techno

Cloud Engineer Senior (1) Informatica

Sun Radia

McLean, Virginia, USA

Part-time

Cloud Engineer Senior (1) Informatica JD - Required Skills: Strong Hands-on experience with ETL and Data Integration tools, including Informatica PowerCenter, IICS and IDMC Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM Proficient in Python, Spark, Java and/or Scala programming languages Experience with development on AWS and cloud native applications Experience with Linux, shell scripting and the full ELK

Machine Learning Engineer with Generative AI

PETADATA

Las Vegas, Nevada, USA

Full-time, Third Party, Contract

Job Title: Machine Learning Engineer with Generative AI Location: Las Vegas, NV - REMOTE EXPERIENCE: 12+ YRS Job Type: W2/C2C PETADATA is currently hiring for the position of Machine Learning Engineer with Generative AI for one of their clients. Job Overview: We seek a forward-thinking Machine Learning Engineer with a deep focus on Generative AI technologies within the Azure ecosystem. This pivotal role is dedicated to pioneering AI-driven solutions, mainly to deploy a state-of-the-art chatb

Data Scientists to build and deploy ML/AI

Macrosoft

Bedminster, New Jersey, USA

Contract

Looking for Data Scientists to build and deploy ML/AI solutions that enhance personalization, marketing effectiveness, channel optimization, customer experience, and efficiency Create models to predict customer behavior (churn, intent, acquisition) for targeted marketing campaigns Work with ML engineers to deploy models in batch and realtime production, establishing performance monitoring pipelines Conduct research on new ML/AI techniques, stay current on best practices, and champion innovation

Delivery Lead

Acunor Infotech

Atlanta, Georgia, USA

Contract, Third Party

Job Title : Delivery Lead Location : Jersey City_NJ &Charlotte_NC & Atlanta, GA / Onsite Duration : 6+ Months Job Description: Responsibilities: Oversee and drive the delivery of end-to-end projects focused on analytical applications and ETL projects. Provide technical leadership and mentorship to data engineering teams, guiding them on complex challenges and best practices. Collaborate with business and technical stakeholders to gather requirements, design solutions, and manage project deliv

Data Engineer

Axiom Technology Group

California, USA

Third Party, Contract

Data Engineers Location: San Jose, ( Hybrid: Tues, Wed, Thurs- in Office) Overview: We are seeking a highly skilled Data Engineer with strong expertise in Databricks to lead the design and execution of scalable data pipelines and architectures. This role sits at the intersection of Customer Analytics, Master Data Management (MDM), and Generative AI/LLMs. The ideal candidate also brings experience building custom applications, supporting BI integration, reverse ETL workflows, and applying

Quality Engineer

Echo IT Solutions, Inc.

Cleveland, Ohio, USA

Contract

Job Title: Quality Engineer Job Type: Long-Term Contract Location: Cleveland, OH (3 days Onsite in week)Job Description:6+ years exp as Quality Engineer coordinating with US-based and international personnel Required Skills: Big data Hadoop (hive, impala, spark, etc). Strong in Hadoop testing Python development background for writing Python scripts for automation Will be using their own automation tool (not QfaaS) No manual testing SQL HQL nice to have Heavy backend data testing No particular

Quality Engineer

Echo IT Solutions, Inc.

Pittsburgh, Pennsylvania, USA

Contract

Job Title: Quality Engineer Job Type: Long Term Contract Location: Pittsburgh, PA (3 days Onsite in week)Job Description:6+ years exp as Quality Engineer coordinating with US-based and international personnel Required Skills: Big data Hadoop (hive, impala, spark, etc). Strong in Hadoop testing Python development background for writing Python scripts for automation Will be using their own automation tool (not QfaaS) No manual testing SQL HQL nice to have Heavy backend data testing No p

Senior Data Engineer(only W2 candidates with min 8+ Years of experience)

HPTech Inc.

New York, New York, USA

Contract

Job Title: Sr Data Engineer Location: NYC NY(onsite) Duration: Contract Job Description: Required Skills: 1.Proficiency in data engineering programming languages (preferably Python, alternatively Scala or Java)2. Proficiency in atleast one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)3. Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Ora

Fulltime Azure Databricks Platform Administrator @ Birmingham, AL / Raleigh, NC / Maryville, TN / Memphis, TN / Dallas, TX

MRoads

Dallas, Texas, USA

Full-time

Hi, We are currently hiring for a role that I believe aligns well with your experience, and I would love to connect with you to share more details. Job Title: Azure Databricks Platform Administrator Location: Birmingham, AL / Raleigh, NC / Maryville, TN / Memphis, TN / Dallas, TX Full Time position Onsite position Experience and Education: 9 years of relevant experience required.Experience with Azure Databricks preferred.Bachelor s degree in related field required (combination of education and

Java Developer with MongoDB

Accuro Group

McLean, Virginia, USA

Third Party

Note: We are looking for Local Candidates of McLean, VA & Plano, TX Design, develop, and maintain scalable and high-performance Java-based applications with a focus on data-intensive processes. Work extensively with MongoDB and other NoSQL databases to manage and optimize data storage and retrieval. Collaborate with cross-functional teams to architect solutions leveraging AWS services such as S3, Lambda, EC2, RDS, etc. Implement and maintain data pipelines and streaming solutions using tools li

Full Stack Developer - REMOTE

Contract Staffing Recruiters

Remote

Contract

The Opportunity: We are seeking a full stack engineer/developer with experience in projects emphasizing big data and application migration. This person will be responsible for supporting our customers migration of hundreds of applications to Databricks including authentication, rewiring of connections, building new libraries, and adapting notebooks and code. Work with the Business Intelligence team and operational stakeholders to design and implement migration strategy of read only and transact

asp.net developer

HCL America Inc.

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 218,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version

Data Infrastructure Engineer

Bayside Solutions

Remote

Contract

Data Infrastructure Engineer W2 Contract Salary Range: $124,800 - $145,600 per year Location: Remote Role - PST Job Summary: We require a Data Infrastructure Engineer with strong expertise in distributed systems, API development, and software engineering. This role requires hands-on experience building distributed applications in Scala and Kubernetes. Duties and Responsibilities: Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day Develop migration tooling t

AI Data Engineer

TetriQ Solutions LLC

Redmond, Washington, USA

Third Party, Contract

Position :AI Data Engineer Location: Remote Duration: 6 months Job Responsibilities: As a Data Engineer in MDO, you will drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements Build scalable data models and data pipelines to extract, load and transform data, ensure secure data storage, with focus on data quality and compliance on Azure using services (ADF, HDI, Databricks, Synapse/Fabric etc.) You will play a critical role in

Senior Data Scientist - Plano TX

AgreeYa Solutions

Plano, Texas, USA

Third Party, Contract

Title- Senior Data Scientist Location- Plano TX (On-site) Duration: 18 months Job Summary: We are seeking a highly skilled Data Scientist with a strong foundation in Python, Machine Learning, and Generative AI to join a dynamic and innovative team. The ideal candidate will bring hands-on expertise in Natural Language Processing (NLP), Large Language Models (LLMs) (especially OpenAI), and advanced data analytics platforms such as Databricks and MongoDB. This role requires a balance of technical