Apache Spark jobs in Wisconsin

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Senior Telecom Data Engineer - Verizon, AT&T, Nokia, Tmobile experience only with Python, BigQuery, Looker, Tableau, Power BI, Spark (PySpark)

Remote

•

Today

Senior Data Engineer - lead the technical delivery of a data and analytics program for a large enterprise telecom customer. You'll own the work from ingestion through to dashboards. You'll be the main technical contact with the customer's data and engineering teams, and you'll work with a distributed team that uses AI-assisted development every day. This is a 6 months contract with a potential to extend. Please note that candidates must be based in the United States and available to travel to c

Easy Apply

Third Party, Contract

55 - 67

Junior Data Engineer (0-5 Years)

Remote

•

Yesterday

Job Title: Junior Data Engineer Location: Across USA (Hybrid/Remote) Job type: Fulltime Job Description: Responsibilities: Develop and manage data pipelines using tools like Python, SQL, Spark, or similar technologies Ensure data quality, integrity, and consistency across systems Work with structured and unstructured datasets from multiple sources Assist in designing and maintaining data warehouses/lakes Monitor pipelines and troubleshoot performance issues Collaborate with cross-functional tea

Easy Apply

Full-time

Depends on Experience

AI/ML Engineer - Houston, TX, San Antonio, TX, Dallas, TX, Austin, TX.

Remote or Houston, Texas

•

Today

Job: Senior AI/ML Engineer Location: Houston, TX, San Antonio, TX, Dallas, TX, Austin, TX. Contact: 12+ Months Looking for W2 candidates. No C2C Responsibilities: Design, develop, and deploy AI/ML models for enterprise applications. Build scalable machine learning pipelines and data preprocessing workflows. Develop and optimize LLM, NLP, and Generative AI solutions. Integrate AI models with cloud platforms and production systems. Monitor model performance, retrain models, and improve accuracy.

Easy Apply

Contract

Depends on Experience

Databricks Engineer

Remote

•

Today

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Third Party, Contract

$70 - $80

Data Architect

Remote

•

21d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Palantir Consultant

Remote

•

2d ago

Job Title: Palantir Consultant Experience: 510+ Years Employment Type: Contract Work Mode: Remote The consultant will work closely with business stakeholders, data engineers, architects, and technical teams to design, develop, and implement scalable data-driven solutions using Palantir technologies. Key Responsibilities - Design, develop, and implement solutions using Palantir Foundry and/or Gotham. - Build and maintain data pipelines, workflows, and data integration processes. - Wor

Easy Apply

Contract, Third Party

Depends on Experience

AWS Data Engineer

Remote

•

Today

Position Overview The Commonwealth of Pennsylvania is seeking a Data Engineer & Insights Analyst to transform complex data into actionable insights for the Pennsylvania Longitudinal Data System (PALDS). This role involves building cloud data pipelines, integrating multi-source datasets, ensuring data quality, and creating analytics tools to support government decision-making. Key Details Work Arrangement: Remote Location: Harrisburg, PA Interview Process: Round 1 (Teams / Virtual) | Round 2 (In-

Easy Apply

Third Party, Contract

Depends on Experience

Databricks Engineer with Health Insurance

Remote

•

3d ago

Over 8 Years of experience in IT. Design and implement end-to-end lifecycle of Databricks platform on AWS.Good experience in working with Healthcare insurance clients.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.Deep expertise i

Easy Apply

Contract

Depends on Experience

Databricks Engineer

Remote

•

3d ago

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Remote

•

Today

Role: Senior Data Engineer DataStage to Azure Databricks Migration Remote Job Description: Strong hands-on experience in IBM DataStage, Teradata, SQL and Azure Databricks. Analyze existing DataStage jobsand their Teradata dependencies. Knowledge of Teradata utilities/components such as BTEQ and TPT. Experience configuring or working with JDBC/ODBC database connectivityfrom ETL platforms. Identify and remediate Teradata-specific SQLfor compatibility with Databricks/Spark SQL Perform data

Easy Apply

Contract, Third Party

60 - 65

Senior Databricks Engineer

Remote

•

Today

Position: Senior Databricks Data Engineer Location: Remote / Hybrid Duration: Long Term Responsibilities Develop scalable data pipelines using Databricks, PySpark and SQL.Build and maintain Delta Lake tables using the Medallion Architecture.Develop batch and real-time data processing pipelines.Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.Optimize Spark jobs, SQL queries and Delta tables.Implement data governance and security using Unity Catalog.Develop Databricks Work

Easy Apply

Contract, Third Party

Depends on Experience

Forward Deployed Engineer (Databricks)

Remote

•

15d ago

Senior Forward Deployed Engineer, Data & AI We''re looking for a hands-on engineer who thrives working side-by-side with clients to solve real-world data problems. You''ll be involved with technical delivery end-to-end building the data pipelines that move information from raw to ready, and the models that turn it into insight. What you''ll do: Partner directly with clients and product teams, translating business problems into technical requirements (and technical solutions back into plain-lang

Easy Apply

Contract

65 - 80

Claude AI Architect (Databricks, Healthcare)

Remote

•

Today

Note: 15+ years in IT, with 5+ years as a solution or data architect.6+ years building LLM applications in production, including 4 years+ of hands on work with Claude models and the Claude Developer Platform (Messages API, tool use, structured outputs, prompt caching, thinking, batch processing). What you will do: Architecture and solution design Own end-to-end architecture for Claude-powered applications and agents on Databricks: retrieval-augmented generation, multi-step agents, document int

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote

•

2d ago

We are seeking aSenior Databricks Engineerto design, build, and optimize scalable data platforms and analytics solutions usingDatabricks. This role will be responsible for developing robust data pipelines, enabling advanced analytics, and supporting enterprise data modernization initiatives across cloud environments. The ideal candidate will bring deep expertise inDatabricks, Apache Spark, Delta Lake, and cloud-native data engineeringpractices. Key ResponsibilitiesDesign, develop, and maintain s

Easy Apply

Contract

Depends on Experience

Lead Sr Software Engineer (Cloudera Hadoop stack)

Remote

•

7d ago

Lead Sr Software Engineer (Cloudera Hadoop stack) REMOTE Visa Eligibility:Please confirm if the candidate is legally authorized to work in the United States Experience Level: 10+ years Contract 12 months Qualifications: Bachelors degree in computer science, Information Technology, Information Systems, or related field. 10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws. The ideal candidate will possess deep expertise

Easy Apply

Contract, Third Party

60 - 70

Iceberg DBA REMOTE

Remote

•

Today

Interview Mode :MS teams Must have :Iceberg DBA experience in Big Data / Data Operations / DBA roles Minimum 1+ year of experience with Apache Iceberg or similar table formats (Hive/Delta/Hudi) 4+ years of experience with Cloudera ecosystem (CDP)Hands-on experience with: Iceberg table operations and maintenance Spark SQL, Hive, or Impala Experience in: Production support and incident handling Monitoring, troubleshooting, and operational support Apply established data modeling and Lakehouse stand

Contract

$40 - $50

AI & Data Architect (Databricks | Lakehouse | AI)

Remote

•

9d ago

Role: AI & Data Architect (Databricks | Lakehouse | AI) Location:Indianapolis, IN (Remote but 1-2 days a month travel to client's office in Indianapolis) About the role Define scalable enterprise data architectures that support Analytics, AI, and GenAI initiatives. Translate business and data challenges into scalable architectures and new engineering initiatives. Responsibilities Design enterprise data architectures on Databricks and the LakehouseBuild ETL/ELT, data integration, and scalable pla

Easy Apply

Contract

Depends on Experience

Databricks Architect / Resident Solution Architect

Remote or Hybrid in San Francisco, California

•

8d ago

Job Title: Databricks Architect / Resident Solution Architect Openings: 2 Location: San Francisco, CA Local preferred; Remote considered Work Hours: Must be able to work PST hours Duration: 812 Months Visa: Any Rate: flexible Industry: Banking / Financial Services Experience: 1215+ Years Job DescriptionWe are looking for a highly experienced Databricks Architect / Resident Solution Architect with strong hands-on Data Engineering and Databricks architecture experience. The ideal candidate should

Easy Apply

Full-time

Depends on Experience

FinOps Specialist Databricks and Cloud

Remote

•

Today

Position Summary We are seeking a FinOps Specialist to manage cost visibility, forecasting, financial governance, and optimization for a large-scale Databricks and cloud data platform. This role will partner with engineering, operations, finance, procurement, and program leadership to monitor cloud consumption, identify savings opportunities, improve cost allocation, and ensure platform spending remains aligned with project and business objectives. Key Responsibilities Monitor and analyze Databr

Easy Apply

Contract

Depends on Experience

Apache Spark jobs in Wisconsin, USA