apache spark Jobs in texas

Refine Results
341 - 360 of 425 Jobs

Data Engineer

InterSec Inc.

•

Houston, Texas, USA

Contract

Data Engineer Houston, TX/Spring TX- Onsite Skills Required: Python, Databricks (SQL/Data Engineering), Apache Spark Responsibilities: Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark.Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions.Implement and optimize ETL processes to ensure data quality and integrity.Develop and maintain SQL queries and scripts for data extraction, transformation, an
Easy Apply
Posted 2 days ago | Updated 2 days ago

Confluent/Kafka Developer

Advanced Technology Group, Inc

•

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong
Easy Apply
Posted 5 days ago

Azure Data Architect with MS Fabric - w2 role

Xyant Services, Inc.

•

Remote or Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a highly experienced Data Engineering Lead/Architect with a strong background in SQL, Azure Data Services, and data modeling. The ideal candidate will possess a deep understanding of data warehousing, ETL/ELT processes, and big data technologies, and be capable of driving both the technical execution and team coordination in a fast-paced, dynamic environment.Key Responsibilities:Design, develop, and optimize complex SQL queries, dimensional data models, and schema
Easy Apply
Posted 2 days ago

Google Cloud Platform Data Engineer

Nityo Infotech Corporation

•

Richardson, Texas, USA

Full-time

Job Role: Google Cloud Platform Data Engineer Job Location: Richardson, TX Job Type: Full Time Job description: Client is seeking a Google Cloud Platform Data Engineer with experience working in a Big Data ecosystem. The position will primarily be responsible interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation and Design. You will play an important role in creating the high-level d
Easy Apply
Posted 5 days ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 4 days ago

Google Cloud Platform Architect

Estuate Inc.

•

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected
Easy Apply
Posted 59 days ago | Updated moments ago

Palantir Foundry Developer / Data Engineer

GreyMatter Solutions

•

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp
Easy Apply
Posted 20 days ago | Updated moments ago

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

•

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p
Easy Apply
Posted 7 days ago | Updated 4 days ago

Machine Learning Engineer (Infrastructure)

Photon

•

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras
Easy Apply
Posted 20 days ago | Updated 10 days ago

Backend Software Engineer, ML

Bayside Solutions

•

Remote

Contract

Backend Software Engineer, ML W2 Contract Salary Range: $135,200 - $156,000 per year Location: Remote Role - PST Job Summary: As a Backend Software Engineer, you will work with the engineering team, EPM, and customers to support customer migration to next-generation services that generate, manage, and consume datasets, features, and embeddings used for ML training. You will utilize tooling to migrate data and work with customers to change their Python clients to start using the new SDK. Thi
Easy Apply
Posted 25 days ago | Updated 2 hours ago

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

•

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami
Easy Apply
Posted 30 days ago | Updated moments ago

Google Cloud Platform Data Engineer

EPSoft Technologies LLC

•

Dallas, Texas, USA

Third Party, Contract

Role: Google Cloud Platform Data Engineer Location: Dallas, TX Type: Contract Min Exp required: 10+ years Relevant candidate from Healthcare & Pharma background mostly in the recent 5 years Job Description: Experience with Google Cloud Platform services such as Compute Engine, Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, DataFrames, PyTest Develop and i
Easy Apply
Posted 17 days ago | Updated 3 days ago

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

•

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl
Easy Apply
Posted 11 days ago | Updated 2 hours ago

Data Scientist

BEAT LLC

•

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati
Easy Apply
Posted 33 days ago | Updated 13 days ago

SQL Developer - 12+ Yrs Exp - Healthcare Domain must - REMOTE - Minneapolis, MN

Cynosure Technologies LLC

•

Remote

Contract

Job - SQL Developer - 12+ Yrs Exp - Healthcare Domain must REMOTE - Minneapolis, MN Mandatory Skills - SQL Server, Azure Devops Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data mod
Easy Apply
Posted 2 days ago

Senior ETL Pipeline Engineer (Docker & Kubernetes)

InfoObjects Inc

•

Dallas, Texas, USA

Contract

Senior ETL Pipeline Engineer (Docker & Kubernetes) Location: Dallas, TX (Onsite role) Duration: 6+ Months contract Interview process: 1 video 2 onsite Overview: We are looking for a highly skilled ETL Pipeline Engineer to design, develop, and manage ETL (Extract, Transform, Load) pipelines using Docker and Kubernetes.The ideal candidate will have experience with containerization and orchestration technologies, ensuring efficient and scalable data workflows for our organization.Key Responsibili
Easy Apply
Posted 6 days ago

Platform Engineer with Scala@Sunnyvale,CA Remote

iBrain Technologies Inc.

•

Remote or Sunnyvale, California, USA

Third Party, Contract

Data Platform Engineer with Scala Location: Sunnyvale, CA/Remote Contract 12 Months Exp : 10+ Years Job Description: We are looking for highly skilled Data Infrastructure Engineers with strong expertise in distributed systems, API development, and software engineering. The ideal candidates should have hands-on experience building distributed applications in Scala and Kubernetes. Key Responsibilities: Develop and maintain a batch orchestration platform which runs 100,000+ jobs per day Develo
Easy Apply
Posted 10 days ago | Updated moments ago

SQL Developer

Helix Tech

•

Remote

Full-time

Job Description (Posting). Role - SQL Developer Location - Minneapolis, MN (Remote) Mandatory Skills - SQL Server, Azure DevOps 12+ yrs of Experience Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design a
Easy Apply
Posted moments ago

AWS Snowflake and DBT Data Engineer

Infosys Technologies Ltd

•

Houston, Texas, USA

Full-time

Infosys is seeking an AWS Snowflake and DBT Data Engineer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, w
Easy Apply
Posted 3 days ago | Updated 1 hour ago

ML Engineer

Promantus, Inc

•

Plano, Texas, USA

Contract, Third Party

Position: ML Engineer Location: Plano TX ( Day 1 Onsite Duration: Long Term Job Description: We are looking for a Machine Learning Engineer specializing in NLP to enhance our AI-driven products. You will design, build, and deploy large language models (LLMs) and NLP solutions, leveraging Azure Databricks, Python, and PySpark to deliver scalable and high-performance models. Your work will involve processing large datasets, fine-tuning LLMs, and deploying these models in production environments.
Easy Apply
Posted 31 days ago