Apache Spark jobs in Dallas, TX

Hybrid in Dallas, Texas

•

Today

We are seeking an experienced AWS Data Engineer with 6+ years of experience in data engineering, cloud technologies, and large-scale data processing. The ideal candidate must have strong hands-on experience with AWS, Apache Spark, PySpark, and Databricks to build and optimize scalable data pipelines and data processing solutions. Roles & Responsibilities6+ years of experience in data engineering with strong hands-on expertise in AWS, Apache Spark, PySpark, and Databricks.Design, develop, and mai

Easy Apply

Contract

Depends on Experience

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Python AWS Spark Engineer, Plano, TX (Hybrid)

Hybrid in Plano, Texas

•

16d ago

Python AWS Spark Engineer Location: Plano, TX Duration: Long-TermJob SummarySeeking an experienced Python AWS Spark Engineer to join the team in Plano, TX. The ideal candidate will have strong hands-on experience with Python, Apache Spark/PySpark, AWS cloud services, and data engineering. This role will focus on developing scalable data processing solutions, building cloud-based data pipelines, and supporting enterprise data platforms. Key ResponsibilitiesDesign, develop, and maintain scalable d

Easy Apply

Contract

Depends on Experience

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Azure Databricks Engineer (Pyspark) ADLS Gen2

Dallas, Texas

•

Today

Role: Azure Databricks Engineer (Pyspark) ADLS Gen2 Location: Dallas, TX/ Atlanta, GA-- 5 days onsite - -(Day1 Onsite) Type : Contract/C2C Role Summary We are seeking a Tech Lead to drive the end to end successful migration of enterprise data integration workloads from Informatica to Azure Databricks and to provide thought leadership for the Databricks platform within the supply chain ecosystem. This role combines hands on technical leadership, architecture guidance, delivery ownership, stakeho

Easy Apply

Third Party, Contract

Depends on Experience

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid

Dallas, Texas

•

Today

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) - Onsite Hybrid to join our team in Dallas, Texas (US-TX), United States (US). Join a team building next-generation, cloud-native data platforms powering real-time and batch data movement at enterprise scale. Yo

Full-time

USD 96,492.00 - 144,738.00 per year

Java Full Stack Developer

Hybrid in Irving, Texas

•

29d ago

Title:Java Full Stack Developer Location: Irving, TX or Chandler, AZ (Hybrid) Duration: 18 months, possibility to extend or convert Client: Banking & Finance Summary: Top Skills 5 years Java Spring React/Angular 2 years Python Nice to Have Google Cloud Platform OCP/Kubernetes Spark JOB DESCRIPTION The Currency Transaction Reporting (CTR) technology team supports critical Anti-Money Laundering (AML) and regulatory reporting capabilities for the Risk organization. The team maintains and enhanc

Easy Apply

Contract

$50 - $60

Databricks Platform Engineer

Hybrid in Irving, Texas

•

29d ago

Job Description In this role, you will design, build, and enhance the enterprise Databricks platform to support analytics, data products, machine learning, and AI initiatives across the organization. You will collaborate with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, and Data Science teams to develop reusable platform services, automation frameworks, engineering standards, and self-service capabilities that improve platform adoption, developer experience,

Easy Apply

Contract

Depends on Experience

AI Databricks Engineer

Hybrid in Irving, Texas

•

29d ago

Mandatory skills Data Engineering Design and develop scalable ETL/ELT pipelines using Databricks, Spark, and SQL. Build data ingestion frameworks for structured and unstructured documents. Develop data quality, reconciliation, and validation frameworks.Design medallion architecture (Bronze, Silver, Gold) for document processing workflows. Implement metadata management and lineage tracking. Gen AI & Agentic AI Build Intelligent Document Processing (IDP) solutions using LLMs.Develop AI agents to p

Easy Apply

Contract, Third Party

Depends on Experience

Prompt Engineer

Hybrid in Richardson, Texas

•

7d ago

Prompt Engineer around "Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, Vector Databases, and Prompt Engineering Richardson, TX JD Experience: 4-6 years in Data Engineering and AI solutions. Strong expertise in Python, SQL, PySpack, Databricks/Spark. Hands-on experience with Large Language Models (LLMs) such as OpenAI, Azure OpenAl, Claude, or Llama. Build and deploy Retrieval-Augmented Generation (RAG) applications. Develop AI Agents using LangChain, LangGcapb, C

Easy Apply

Contract

$45 - $50

Sr Data Engineer

Plano, Texas

•

16d ago

Senior Data Engineer Location: Plano, TX Local candidates preferred; onsite final interview Experience: 12+ years Position:W2 Role: Senior Data Engineer responsible for designing, developing, and modernizing enterprise-scale data platforms, with a strong focus on Databricks, Snowflake, Spark, and Java/Python. The role involves integrating data from external partners and migrating legacy platforms to modern cloud-based solutions. Must-Have Skills: 10+ years of Data Engineering experienceStrong J

Easy Apply

Contract

Depends on Experience

Lead Data Engineering

Dallas, Texas

•

9d ago

Experience: Must have 12+ years of experience Job Description Key Responsibilities: - Design, develop, and maintain data pipelines using Apache Airflow DAGs. - Build and optimize ETL/ELT workflows using Databricks (PySpark/Spark). - Develop and manage data warehousing solutions in Snowflake and SQL. - Lead technical design, code reviews, performance tuning, and production support. - Collaborate with cross-functional teams to deliver reliable and high-quality data solutions. - Mentor team members

Easy Apply

Full-time

Depends on Experience

Full-Stack Architect

Hybrid in Plano, Texas

•

Yesterday

Hiring: Full-Stack Architect / Technical E-Commerce Lead Location: Plano, TX (Local Candidates Only Hybrid) Domain: Retail / E-Commerce Key Skills: Frontend: React, Next.js, TypeScript, JavaScript Backend: Java/Spring Boot, Node.js, Python, or Go Microservices, Spark jobs, and distributed systems Hands-on coding, system architecture, performance optimization, and troubleshooting Strong experience with modern digital and e-commerce platforms

Easy Apply

Full-time

Depends on Experience

Apache Spark jobs in Dallas, TX, USA