apache spark Jobs

Refine Results
1,701 - 1,720 of 1,941 Jobs

Data Engineer

Rezult Group, Inc

Remote

Full-time

This individual will be responsible for: Designing robust, componentized, and adaptable processes to scale-up our business intelligence platform.Understanding big data and cloud technologies and quickly become productive with, and provide analysis on these toolsHaving strong SQL experience and the ability to work with cloud infrastructure programs, OOD, and data pipelinesIdentifying inefficiencies in code or processes and recommend solutions.Being able to adapt quickly to changing requirements a

Azure Data Engineer

Acadia Technologies, Inc.

Las Vegas, Nevada, USA

Full-time

Technical Skills:Azure Services:Deep understanding and experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure Databricks, Azure SQL Database, Azure Cosmos DB, and other relevant Azure data services. Data Warehousing and Data Lakes:Knowledge of designing, implementing, and managing data warehouses and data lakes on Azure. ETL Processes:Expertise in developing and maintaining ETL (Extract, Transform, Load) pipelines using tools like Azure Data Factory. Progr

Data architect with finance insurance Domain

HAN IT Staffing Inc.

Remote

Third Party, Contract

Roles & Responsibilities: Lead architecture and design of a centralized pricing database for actuarial modeling.Define the data strategy and integration roadmap in collaboration with stakeholders.Architect scalable data ingestion and transformation solutions using AWS, Databricks, SQL, and CData.Ensure data governance, security, and performance optimization.Provide leadership and direction to the offshore development team, ensuring alignment with business objectives. Required Technical Skills: C

Business Intelligence Developer

SBS Creatix, LLC

O'Fallon, Illinois, USA

Full-time

Business Intelligence Developer Our client is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis. Responsibilities Design

Python Developer with hands-on experience in Artificial Intelligence and Machine Learning

TechSME Inc

Redmond, Washington, USA

Contract

We are seeking a highly skilled Python Developer with hands-on experience in Artificial Intelligence and Machine Learning to join our dynamic team. The ideal candidate will play a key role in building intelligent applications and scalable ML pipelines, working closely with data scientists, engineers, and product teams. Required Skills: Strong proficiency in Python and its ecosystem (NumPy, Pandas, Flask/FastAPI).Experience with AI/ML frameworks such as TensorFlow, PyTorch, Scikit-learn.Knowledge

Sas lead and developer

Hexaware Technologies, Inc

Irving, Texas, USA

Full-time

Role : Sas lead/ developer Location : Irving, TX (Hybrid 3 days) Hire Type : Fulltime Job Description: Responsibilities:Analyze SAS programs to understand sources, dependencies, data flow.Sanitize SAS programs in preparation for conversion.Optimize SAS programs in preparation for conversion.Incorporate changes in accelerator to ensure generated code aligns to required standardsUtilize accelerator to convert SAS programs to PySpark programs.Demonstrate and document code lineage.Unit Test ge

Data Engineer

MARKS IT SOLUTIONS LLC

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CA (Onsite) Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements to existing systems and participate in rot

Machine Learning Engineer

Federal Soft Systems Inc.

Redwood City, California, USA

Full-time

Lead Machine Learning Engineer Hybrid 3 days/week onsite (Mon, Wed, Thurs) | Full-Time Location: Redwood City, CA Have to come from an e-commerce, e-market background think Etsy, Wayfair, TikTok, Instagram, Poshmark, Mercari, Depop, Shopify, Amazon, eBay, ThredUp, Vinted, Target, etc. (think social e-commerce, like apps you buy things from) Client is an e-commerce, community-driven marketplace. What You ll Do: - Build and deploy ML models on large-scale data - Lead algorithm development for b

Data engineer - only local to Dallas TX

Intellisoft Technologies

Plano, Texas, USA

Contract

Role: Java Data engineer Location: Plano, TX | Hybrid Option Duration: 6-month open-ended Contract (no contract maximum)Required Qualifications: 8+ years of Java developer experience3+ data engineer expSolid experience writing clean, concise, tested, maintainable code in Java.Experience building and deploying applications in AWSAPI development experienceExperience utilizing Spark and SQLExperience with Databricks or EMRTerraformExperience with CI/CD and updating build pipelines and pipeline task

SQL Developer with PySpark and Python

Princeton IT Services

Pittsburgh, Pennsylvania, USA

Third Party, Contract

Job Title: SQL Developer with PySpark and Python Location: Pittsburgh, PA (Hybrid) Job Type: Contract Position Summary: We are seeking a highly skilled SQL Developer with strong expertise in PySpark and Python to support data engineering and analytics initiatives. The ideal candidate will work on developing and optimizing complex SQL queries, building scalable data pipelines, and supporting the transformation and processing of large data sets in a distributed environment. Key Responsibilit

Data Engineer - Remote - Exp in Java Script and React Js - Direct Client - W2

Outcome Logix LLC

Brooklyn, New York, USA

Contract

Key Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.Ensure data quality, integrity, and security across all data pipelines.Optimize and tune data processes for performance and cost-efficiency.Implement and manage data storage solutions on Google Cloud Platform.Monitor and troubleshoot data pipeline issues and implement solutions.Stay up

Hiring for Data Scientist :: Remote

Feuji Inc

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop

Data Modeler /Architect

Lorven Technologies, Inc.

Austin, Texas, USA

Contract

Data Architect Position: Contract (W2) Location: Austin, TX / New York City/ san Diego(CA)/ Fort MIl (SC) [Hybrid] Duration: 12 Months Need 10+ Years candidate. Job description: Required Qualifications: 10+ years of experience in data engineering, solution architecture, or technical leadership roles. Strong expertise in AWS data services (Glue, Athena, S3, Lambda, etc.). Proven experience with Snowflake and building high-performance, cloud-native data warehouses. Solid understanding of ca

Enterprise Data Platform Architect

HMG America

Seattle, Washington, USA

Contract, Third Party

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for (Title) in (Location). Below is the detailed job description. Title: Enterprise Data Platform Architect Location: Seattle Onsite Job Description: About the Role: We are seeking a highly skilled and experienced Enterprise Data Platform Architect to lead

Data Architect

Oscar Technology

Texas, USA

Full-time

Job Title: Databricks Data Engineer Location: On-Site (Multiple Offices Nationwide) Employment Type: Full-Time Salary Range: $165,000 - $185,000 per year + Annual Bonus About the Role: We are seeking a highly skilled Databricks Data Engineer to join our on-site team supporting clients across multiple office locations nationwide. The ideal candidate will have a strong background in designing, developing, and optimizing big data pipelines in Databricks, with solid experience across both Azure and

Direct Client :: Artificial Intelligence Engineer - Agentic Data Engineer _ Richmond, VA 23219 _ Both Phone and In Person

PeopleNTech

Richmond, Virginia, USA

Full-time

Job Title : Artificial Intelligence Engineer - Agentic Data Engineer Start Date: 07/21/2025 End Date: 12/31/2025 Address: Richmond, VA 23219 Interview Type: Both Phone and In Person Work Arrangement: Hybrid Complete Description: The Client is seeking a highly skilled Artificial Intelligence Engineer 4- Agentic Data Engineer to design, develop, train and deploy data models that leverage agentic AI that solve real-world problems. Responsibilities: Gather business needs and translate them to anal

Software Engineer

StoneGate-Technologies LLC

Pittsburgh, Pennsylvania, USA

Full-time

Job Description:We are looking for experienced Senior Software Developers to join an Agile DevOps team working on a high-performance big data platform. The ideal candidate will be responsible for gathering requirements, designing, and developing scalable data solutions including ETL/ELT pipelines, stream processing, and advanced analytics. In addition, maintaining stable production environments and addressing operational issues are key aspects of the role. Key Responsibilities: Collaborate with

AI/ML Data Scientist - Remote / Telecommute

Cynet Systems

Remote

Contract

Job Description: Pay Range: $45hr - $50hr Responsibilities: LLM Integration: Apply LLMs to enhance analytic methodologies and develop intelligent automation solutions. End-to-End Pipelines: Build and maintain full data science pipelines including ingestion, feature engineering, modeling, deployment, and monitoring. Cross-Functional Collaboration: Work closely with engineering, product, and business teams to align models with strategic goals. Innovation Leadership: Lead initiatives in AI/ML innov

Data Engineer

Cyber Space Technologies LLC

New Providence, New Jersey, USA

Contract, Third Party

Role: Sr. Data Engineer Location- Providence NJ (3days Hybrid) Snowflake, Python, Spark and Scala mandatory Job Description CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower businesses around the world to make better, faster operational decisions.

Data Architect- AWS

VDart, Inc.

US

Contract, Third Party

Role: Data Architect- AWS Mode of Work: - Hybrid (Cleveland, Ohio) Contract Role: Design, build, and optimize scalable, secure data solutions on AWS. Key Responsibilities: Design & Develop a scalable data platform to support Reporting & Analytics leveraging AWS Data Platform Architect data lakes (S3, Lake Formation), warehouses (Redshift), and pipelines (Python, Glue, Kinesis). Design Data architecture (Medallion etc.) Design & Develop reusable frameworks Implement ETL/ELT workflows using AWS