Apache Spark jobs in North Carolina

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

W2 Senior Data Engineer - Telecom Background, Python, BigQuery, Looker, Tableau, Power BI, Spark (PySpark)

Remote

•

Yesterday

Senior Data Engineer - lead the technical delivery of a data and analytics program for a large enterprise telecom customer. You'll own the work from ingestion through to dashboards. You'll be the main technical contact with the customer's data and engineering teams, and you'll work with a distributed team that uses AI-assisted development every day. This is a 6 months contract with a potential to extend. Please note that candidates must be based in the United States and available to travel to c

Easy Apply

Contract

55 - 67

Databricks Architect

Charlotte, North Carolina

•

3d ago

Job SummaryWe are seeking an experienced Databricks Architect to design and implement scalable, secure, and high-performance data platforms using Databricks and cloud technologies. The ideal candidate will have strong expertise in data architecture, Lakehouse design, data engineering, and enterprise data platform modernization. Key ResponsibilitiesDesign and implement end-to-end data architectures using Databricks and the Lakehouse platform. Architect scalable data pipelines using Apache Spark,

Easy Apply

Full-time

Depends on Experience

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Senior Data Engineer - Oracle, Spark & Cloud Analytics

Charlotte, North Carolina

•

2d ago

Summary: We are seeking an experienced Senior Data Engineer with deep expertise in Oracle-based analytical platforms and Apache Spark to support large-scale data modernization, migration, and analytics initiatives. The ideal candidate will have hands-on experience building high-performance data pipelines, optimizing large-scale data processing workloads, and integrating enterprise data platforms with modern cloud analytics solutions. Key Responsibilities: Design, develop, and optimize large-scal

Full-time

Python Engineer / Senior Data Engineer with AI Experience

Remote

•

2d ago

Job Title: Python Engineer / Senior Data Engineer with AI Experience Location: Remote Duration 6 month contract to hire Job Description: Overview: At a high level, they have migrated from Hadoop to Google Cloud Platform for data processing. Have a Google Cloud Platform data environment, predominantly for big data applications on the cloud. Seeking 3-5 Senior Level Data Engineers with strong Python skills to support ongoing data migration and ingestion efforts. Source systems: get data from multi

Easy Apply

Contract

$50 - $60

Databricks Engineer

Remote

•

5d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Third Party, Contract

$70 - $80

Data Architect

Remote

•

16d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Sr. Databricks Architect

Remote

•

30+d ago

Location: Remote Work Hours: Must be able to work in Pacific Time (PST) Duration: 12 Months Employment Type: Contract Industry Experience: Public Sector experience required Position Overview We are seeking an experienced Databricks Architect / Resident Solution Architect to design, develop, and deliver modern, scalable data platforms and solutions. The ideal candidate will have extensive experience in data engineering, cloud data platforms, Databricks implementations, and client-facing tec

Easy Apply

Contract, Third Party

$78 - $84

Data Engineer (Inperson Interview)

Charlotte, North Carolina

•

8d ago

Location: Data EngineerCharlotte, NC Local Work: Full-TimeMust Have Technical/Functional Skills:Objective of Role:This role is responsible for leading complex efforts to develop and deliver complex data solutions to accomplish cyber security technology and business goals.Key responsibilities include code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytics data systems.They guide stakeholders, Product Owners, and So

Easy Apply

Full-time

Depends on Experience

Databricks Engineer with Health Insurance

Remote

•

2d ago

Over 8 Years of experience in IT. Design and implement end-to-end lifecycle of Databricks platform on AWS.Good experience in working with Healthcare insurance clients.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.Deep expertise i

Easy Apply

Contract

Depends on Experience

Databricks Engineer

Remote

•

2d ago

Easy Apply

Contract

Depends on Experience

Senior Databricks Engineer

Remote

•

Yesterday

Position: Senior Databricks Data Engineer Location: Remote / Hybrid Duration: Long Term Responsibilities Develop scalable data pipelines using Databricks, PySpark and SQL.Build and maintain Delta Lake tables using the Medallion Architecture.Develop batch and real-time data processing pipelines.Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.Optimize Spark jobs, SQL queries and Delta tables.Implement data governance and security using Unity Catalog.Develop Databricks Work

Easy Apply

Third Party, Contract

Depends on Experience

Forward Deployed Engineer (Databricks)

Remote

•

9d ago

Senior Forward Deployed Engineer, Data & AI We''re looking for a hands-on engineer who thrives working side-by-side with clients to solve real-world data problems. You''ll be involved with technical delivery end-to-end building the data pipelines that move information from raw to ready, and the models that turn it into insight. What you''ll do: Partner directly with clients and product teams, translating business problems into technical requirements (and technical solutions back into plain-lang

Easy Apply

Contract

65 - 80

Data Engineer

Hybrid in Raleigh, North Carolina

•

5d ago

Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries Collaborate closely with data engineers to design and deliver high-quality data products Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats Design and build intuitive, info

Easy Apply

Contract

Depends on Experience

Lead Java Developer (Application Developement).............Remote W2 position

Remote

•

3d ago

Lead Java Developer (Application Development) Remote W2 position 6 months May work remotely but must work ET zone hours Glider assessment 30 minutes zoom video interviews Job Description Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologiesUtilize various programming languages, Open-Source technologies, Relational/NoSQL databases, Containers and a variety of AWS tools and services with a s

Easy Apply

Contract

Depends on Experience

Data Analyst (Exp with Databricks)

Hybrid in Raleigh, North Carolina

•

3d ago

On of our clients is looking for DATA ANALYST based on following skills: This is a hybrid position. The manager is unsure how often he will need the contractor onsite, but the maximum requirement would be threedays a week on Tuesday, Wednesday, and Thursday. The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will be responsible for developing business requirements, supporting

Easy Apply

Contract, Third Party

Depends on Experience

Lead Sr Software Engineer (Cloudera Hadoop stack)

Remote

•

2d ago

Lead Sr Software Engineer (Cloudera Hadoop stack) REMOTE Visa Eligibility:Please confirm if the candidate is legally authorized to work in the United States Experience Level: 10+ years Contract 12 months Qualifications: Bachelors degree in computer science, Information Technology, Information Systems, or related field. 10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws. The ideal candidate will possess deep expertise

Easy Apply

Contract, Third Party

60 - 70

Iceberg DBA REMOTE

Remote

•

2d ago

Interview Mode :MS teams Must have :Iceberg DBA experience in Big Data / Data Operations / DBA roles Minimum 1+ year of experience with Apache Iceberg or similar table formats (Hive/Delta/Hudi) 4+ years of experience with Cloudera ecosystem (CDP)Hands-on experience with: Iceberg table operations and maintenance Spark SQL, Hive, or Impala Experience in: Production support and incident handling Monitoring, troubleshooting, and operational support Apply established data modeling and Lakehouse stand

Contract

$40 - $50

Apache Spark jobs in North Carolina, USA