Apache Spark jobs in Carmel, IN

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Azure Data Engineer

Hybrid in Indianapolis, Indiana

•

Today

Position: Data Scientist / Data Engineer Work Arrangement: Hybrid (Onsite 1 day per week) Location: Indianapolis, IN (Local candidates only) Interview Process: Webcam only Position Overview We are seeking a Data Scientist / Data Engineer to design, build, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Analytics. You will build batch and streaming data pipelines, optimize data warehouse workloads, and implement data governance standards to deliver high-qual

Easy Apply

Third Party, Contract

Depends on Experience

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Watsonx.data Consultant with Spark and scala experience

Remote

•

28d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Azure Databricks Engineer

Hybrid in Indianapolis, Indiana

•

Today

Job ID: IN-812974 Hybrid/Local Azure Databricks Engineer (Databricks/Data Engineer Professional/Azure Data Engineer Associate (DP-203)/12+) with PySpark, Spark SQL, R, transformations/aggregations, ACID, MERGE, OPTIMIZE, Z-order, VACUUM, Git, CI/CD, Azure DevOps/GitHub, Synapse/Power BI experience Location: Indianapolis, IN (Indiana Department of Health Office of Data & Analytics) Duration: 12 Months Local candidates only will be considered for this position. Skills: Master s degree in data scie

Easy Apply

Contract, Third Party

Depends on Experience

Lead Software Engineer, AI Agents & Orchestration

Carmel, Indiana

•

Today

Creating Peace of Mind by Pioneering Safety and Security At Allegion, we help keep the people you know and love safe and secure where they live, work and visit. With more than 40 brands, 14,000+ employees globally and products sold in 130 countries, we specialize in security around the doorway and beyond. Additionally, Allegion is proud to be recognized with the 2026 Gallup Exceptional Workplace Award (GEWA) for the third consecutive year, earning distinction in both the employee engagement and

Full-time

USD 154,450.00 - 205,000.00 per year

Senior Azure Databricks Data Engineer

Hybrid in Indianapolis, Indiana

•

Today

Job Title: Senior Azure Databricks Data Engineer Location: Indianapolis, IN (Hybrid)-Onsite one day per week.Local candidates Position Type: Contract Interview Mode: Web Cam Job Duties Assists with the data technology strategy, including resolvingstrategic data integration issues, such as data quality and stewardship,real-time, Event-based data integration, and crafting a universal vision for data integration Provides direction and oversight for the design and implementation of data solutio

Easy Apply

Contract, Third Party

$40 - $43

Databricks Engineer

Remote

•

7d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

Databricks Consultant ---- 12+ year experience required

Remote

•

16d ago

Need W2 independent candidate'sJob Overview: Seeking an experienced Databricks Consultant with 12+ years of data engineering and analytics experience. The ideal candidate will have strong expertise in Databricks, SQL, Apache Spark, and modern data platforms, with experience designing and implementing scalable data solutions.Key Skills:12+ years of IT/Data Engineering experienceStrong hands-on experience with Databricks, Spark & SQLExpertise in PySpark and data pipeline developmentExperience with

Easy Apply

Contract

Depends on Experience

Data Architect

Remote

•

7d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Data Scientist

Indianapolis, Indiana

•

Today

Job: IN - IDOH Data Scientist (812974) Client: State of Indiana Duration: 1 Year Contract Location: 2 N Meridian St, Indianapolis, IN 46204 - Hybrid Interview: Webcam only Rate: $43.35/hr Designs, builds, and maintains secure, scalable data solutions across Azure Databricks and Azure Synapse Analytics. Local candidates only will be considered for this position. This role supports data integration, pipeline development, data modeling, governance, and documentation while collaborating with cro

Easy Apply

Contract, Third Party

Sr. Databricks Architect

Remote

•

21d ago

Location: Remote Work Hours: Must be able to work in Pacific Time (PST) Duration: 12 Months Employment Type: Contract Industry Experience: Public Sector experience required Position Overview We are seeking an experienced Databricks Architect / Resident Solution Architect to design, develop, and deliver modern, scalable data platforms and solutions. The ideal candidate will have extensive experience in data engineering, cloud data platforms, Databricks implementations, and client-facing tec

Easy Apply

Contract, Third Party

$78 - $84

Senior Data Engineer

Remote

•

7d ago

IntroductionInternational Solutions Group (ISG) is looking for a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for architecting and optimizing our mission-critical financial data platforms. You will work on building high-throughput pipelines for quantitative analysis, regulatory reporting, and risk management. ResponsibilitiesBuild and maintain high-performance ETL/ELT pipelines using Python and JavaOptimize and maintain data frameworks using Hadoop an

Easy Apply

Contract

Depends on Experience

Apache Spark jobs in Carmel, IN, USA