Apache spark jobs in philadephia, pa

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Watsonx.data Consultant with Spark and scala experience

Remote

•

5d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Manager of Software Engineering - Spark, AWS, Databricks, Java

Wilmington, Delaware

•

Today

Job Description This is your chance to change the path of your career and guide multiple teams to success at one of the world's leading financial institutions. As a Manager of Software Engineering at JPMorganChase within the Enterprise Technology, you lead multiple teams and manage day-to-day implementation activities by identifying and escalating issues and ensuring your team's work adheres to compliance standards, business requirements, and tactical best practices. Job responsibilities Provid

Full-time

Senior Data Engineer with Alteryx

Hybrid in Mount Laurel Township, New Jersey

•

8d ago

What Working at Hexaware offers: Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed. Hexaware provides access to a vast array of tools that enhance, revolutionize, and advance professional profile. We complete the circle with excellent growth opportunities, chances to collaborate with h

Easy Apply

Full-time

$100,000 - $130,000

Backend Developer - Hybrid

Wilmington, Delaware

•

Today

Genesis10 is currently seeking a Backend Developer - Hybrid for a contract position with a Major Financial Institution located in Wilmington, DE; McLean, VA; Richmond, VA; or New York, NY. This is a 4+ month contract opportunity. This is a backend developer role focusing on Java, Scala, and Spark. The position involves hands-on work with AWS data pipeline technologies including S3, Glue, Step Functions, and Lambda, within an event-based architecture. Requirements: Experience with Java, Scala, an

Easy Apply

Full-time

USD 63.92 - 71.92 per hour

Backend Java AWS Developer - Wilmington, DE

Wilmington, Delaware

•

Yesterday

A client of Innova Solutions is immediately hiring for a Backend Java AWS Developer Position type: Contract to Hire Duration: 3-6 Months Location: Wilmington, DE As a(n) Backend Java AWS Developer you will: Responsibilities Java/Spring/Microservices Good troubleshooting skills Good CICD experience Docker/Kubernetes is a plus Working with a lot of new tech. The ideal candidate will have: 5 Years/ Java Required Skills & QualificationsMust-have qualifications that candidates must meet to be cons

Easy Apply

Contract

Depends on Experience

Power BI Developer

Philadelphia, Pennsylvania

•

Today

Company Overview: Arctiq is a global, intelligence-driven technology services company delivering professional and managed services across Hybrid Cloud Infrastructure, Networking & Connected Experiences, Cybersecurity, Data & AI, Autonomous Operations & Intelligence, and Enterprise Service Management. We help organizations operate, secure, and modernize complex environments by unifying infrastructure, networking, data, security, automation, and observability under a single, integrated operating

Full-time

Nuuly Services Software Engineer

Philadelphia, Pennsylvania

•

Today

Role Summary Nuuly is looking for an Engineer with the initiative and expertise to take this platform and help mature it into a stable, scalable, and robust backbone for launching the next wave of Nuuly innovations. You'll need a conversational grasp of streaming and message processing fundamentals. Solid confidence with JVM-based tools such as Kotlin, Spring, and Micronaut. You'll also need a reasonable amount of aptitude in designing and integrating Kubernetes services with cloud based platf

Full-time

Data Software Engineer

Philadelphia, Pennsylvania

•

Today

The Role As a Senior Software Developer (Data Engineering) you'll play a critical role in building and maintaining the data solutions that power regulatory reporting across U.S. equity and options markets. You'll thrive in this position if you're analytical, solutions-oriented, and collaborative - someone who takes ownership of complex technical problems and delivers reliable, scalable outcomes in a fast-paced environment. Key Responsibilities Design, develop, and maintain Java and Scala-based b

Full-time

Compensation information provided in the description

Senior Data Architect

Plymouth Meeting, Pennsylvania

•

Today

Senior Data Architect Location: Plymouth Meeting, PA - Hybrid Type: Full-time, permanent A large and well-established organization is hiring a senior architect to shape how the business designs, governs, and uses its data. You will set the direction for data management standards and lead the move to a modern, unified analytics platform. You'll work with senior stakeholders to turn complex business needs into scalable, secure architecture that supports better decisions across the organization. Th

Easy Apply

Full-time

Machine Learning Engineer III

Remote or West Chester, Pennsylvania

•

Today

Take on a hands-on role developing machine learning solutions that support real products and applications. As a Machine Learning Engineer , you'll work across algorithm development, data pipeline design, model training, validation, deployment, and monitoring. You'll help move machine learning projects from early concepts into reliable, production-ready solutions. This opportunity is a strong fit for an experienced engineer who enjoys both the technical depth of machine learning and the collabor

Easy Apply

Contract

AI/ML Engineer

Malvern, Pennsylvania

•

Yesterday

AI/ML EngineerIntroduction:As an AI/ML Engineer, you will be responsible for developing and implementing artificial intelligence and machine learning solutions within our team. You will work on cutting-edge projects that leverage AI and ML technologies to drive innovation and enhance our products. Responsibilities:Design, develop, and deploy AI/ML models and algorithms.Collaborate with cross-functional teams to understand project requirements and deliver solutions.Optimize and improve existing A

Easy Apply

Full-time

Machine Learning Engineer IV

Remote or West Chester, Pennsylvania

•

Today

Lead the development of machine learning solutions that move from research and experimentation into real-world products and applications. As a Machine Learning Engineer IV, you'll design data pipelines, refine and validate algorithms, deploy models into production, and help establish the technical foundation for future machine learning initiatives. This role is a strong fit for an experienced engineer who enjoys solving complex problems and working across teams to turn ideas into reliable solut

Easy Apply

Contract

Data Engineer (AWS, Azure, Google Cloud Platform)

Philadelphia, Pennsylvania

•

Today

Company Description CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and gover

Full-time

Apache spark jobs in Philadelphia, PA, USA