apache spark Jobs in minneapolis, mn

Refine Results
241 - 260 of 301 Jobs

Senior AI Engineer

KONNECTINGTREE INC

•

Remote

Full-time

Key Responsibilities: Design and implement robust feature engineering pipelines to extract meaningful signals from structured and unstructured email data.Build and fine-tune deep learning and traditional ML models to detect malicious intent in emails (e.g., phishing, malware).Collaborate with security analysts and data engineers to define threat patterns and data labeling strategies.Use MLflow to manage the complete machine learning lifecycle including experimentation, reproducibility, deploymen
Easy Apply
Posted 1 day ago

Databricks Certified Data Engineer

Satsyil Corporation

•

Remote

Full-time

Role: Sr. Databricks Architect with Databricks certification. Location: 1775 Tysons Blvd, VA (REMOTE). Duration: FTE. Job Description: Satsyil Corp is currently seeking a highly skilled and motivated Senior Databricks Architect to join our team and contribute to the success of our Enterprise Data Services project. As a Databricks Architect, you will play a crucial role in developing and optimizing Spark applications in AWS Databricks, leveraging your expertise in Python, SQL, and pySpark. The id
Easy Apply
Posted 1 day ago | Updated 18 hours ago

Sr Data Engineer

Applet Systems

•

Remote

Contract

Lead Data EngineerRemote Longterm.W2 only ( Please don't apply CTC candidates !! ) -Senior level Big Data Architect - 5+ Years experience in Solutions Architecture -Python, Spark, AWS and experience working with data pipelines -Strong experience maintaining and building the new data pipelines -EMRs
Easy Apply
Posted 25 days ago | Updated 4 days ago

Senior AI Engineer - 100% Remote

Tek Ninjas

•

US

Contract

Title: Senior AI Engineer Location: Remote, USA 6+ months contract to hire About the Role: We are looking for an experienced AI/ML Engineer with deep expertise in feature engineering and model engineering to join our team supporting a global email production suite used across Google Workspace (Gmail). The core mission is to build and optimize machine learning models that can detect and prevent threats embedded in email content, attachments, and metadata. You will work with large-scale datas
Easy Apply
Posted 17 hours ago

Data Architect Azure Databricks

Inherent Technologies

•

Minneapolis, Minnesota, USA

Contract, Third Party

Data Architect Azure Databricks 15+ years of Data Solutions Design/Development Experience with at-least 2+ years working as Lead Data Architect for a medium to large sized project or proposal Be able to Design & Develop and Discuss with client architect/team around data architecture and data related issues Analyze and assess the impact of the requirements on the data and its lifecycle, Lead the data architecture design of medium to complex data analytics applications and systems Strong experienc
Easy Apply
Posted 60+ days ago | Updated 5 hours ago

Databricks Architect - AI/ML

Swanktek

•

Remote

Full-time

Required Skills12+ years in data engineering or architecture, with a strong focus on Databricks (at least 4-5 years) and AI/MLenablement.Deep hands-on experience with Apache Spark, Databricks (Azure/AWS), and Delta Lake.Proficiency in AI/ML pipeline integration using Databricks MLflow or custom model deployment strategies.Strong knowledge of Apache Airflow, Databricks Jobs, and cloud-native orchestration patterns.Experience with structured streaming, Kafka, and real-time analytics frameworks.Pro
Easy Apply
Posted 2 days ago

Data Engineer

SSTech LLC

•

Remote

Contract

Data Engineer | Remote need 12+ years of experience AWS stack: Amazon S3, EMR/EC2/Serverless, Spark Lake Formation, Glue Catalog, Athena Open Table Formats: Iceberg, Hudi Frontend: Angular Graph/Metadata: Amazon Neptune DB Event & Integration: EventBridge, SNS, SQS, API Gateway, AWS Lambda Infrastructure as Code: Terraform, CloudFormation, IAM Our top priorities include: Data Products development leveraging DFPaaS (Data Factory Platform as a Service) across CPPIB Data Product Producers Strength
Easy Apply
Posted 19 hours ago

Data Engineer

Rezult Group, Inc

•

Remote

Full-time

This individual will be responsible for: Designing robust, componentized, and adaptable processes to scale-up our business intelligence platform.Understanding big data and cloud technologies and quickly become productive with, and provide analysis on these toolsHaving strong SQL experience and the ability to work with cloud infrastructure programs, OOD, and data pipelinesIdentifying inefficiencies in code or processes and recommend solutions.Being able to adapt quickly to changing requirements a
Easy Apply
Posted 3 days ago

Data architect with finance insurance Domain

HAN IT Staffing Inc.

•

Remote

Contract, Third Party

Roles & Responsibilities: Lead architecture and design of a centralized pricing database for actuarial modeling.Define the data strategy and integration roadmap in collaboration with stakeholders.Architect scalable data ingestion and transformation solutions using AWS, Databricks, SQL, and CData.Ensure data governance, security, and performance optimization.Provide leadership and direction to the offshore development team, ensuring alignment with business objectives. Required Technical Skills: C
Easy Apply
Posted 1 day ago | Updated 1 day ago

Data Scientist / ML Engineer :: Remote

Caspex Corporation

•

Remote or Sunnyvale, California, USA

Contract

Qualifications Solid background in machine learning, deep learning, statistical analysis, and software developmentProficient in data mining, machine learning, and deep learning packages in Python/Tensorflow/KerasExperience working with large data sets and cloud computing (Hive, Spark, Google Cloud Platform, or Azure)Proficient in coding SQL, Python, Java, or JavaScriptAdvanced degree (Master or PhD) in any STEM field plus 4~6 years of related experienceOption 1- Bachelor s degree in Statistics,
Easy Apply
Posted 1 day ago

Hiring for Data Scientist :: Remote

Feuji Inc

•

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop
Easy Apply
Posted 59 days ago | Updated 2 days ago

Lead-Site Reliability Engineer

Kodeva LLC

•

Remote

Full-time

Role - LEAD/ Senior Site Reliability Engineer Remote Full time Experience Range: 8 to 15 years Mandatory Skills: Linux, AWS or Google Cloud Platform, Kubernetes, Python/Shell or any scripting. Additional Skills (good to have) : Prometheus & Grafana, Kafka Administration, Docker, Jenkins, Terraform Location: Anywhere in USA and Canada 1. Good experience of maintaining production systems on AWS and/or Google Cloud Platform as SRE 2. Hands on with Linux and Python, Shell or any scripting language.
Easy Apply
Posted 8 days ago | Updated 15 hours ago

Databricks Senior Manager

Oscar Technology

•

Remote

Full-time

Senior Manager, Databricks Location Remote Overview Databricks is seeking a seasoned Senior Manager to lead the strategy, implementation, and operation of our Databricks platform across Azure, AWS, and Google Cloud Platform. You'll manage and mentor a high-performing team, oversee cloud-native data platform initiatives, and ensure reliable, scalable analytics and AI capabilities. Key Responsibilities Lead and develop a team of data engineers, platform specialists, or solution architects, setti
Easy Apply
Posted 18 days ago | Updated 7 hours ago

Data Engineer

HCL America Inc.

•

Remote

Full-time

HCLTech is looking for a highly talented and self- motivated Data Engineer to join it in advancing the technological world through innovation and creativity. Job Title: Data Engineer Job ID: 1594508BR Position Type: Full-time/ remote ship required based on client requirement or Secret Clearance required Role/Responsibilities Python, AWS Glue, Iceberg, Redshift, S3, Lambda, Terraform, Spark, API Gateway Secondary Skills (knowledge is a must): Data modeling and ETL We are seeking a Mid-Level Data
Easy Apply
Posted 3 days ago | Updated 3 days ago

Databricks Architect

Showman Staffing

•

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level:10+ Years About the Role We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure archit
Easy Apply
Posted 10 days ago

Fraud SME

Prodware Solutions

•

Remote or Malvern, Pennsylvania, USA

Full-time

This is Aishwary fromProdware Solutions LLC. We have a role which closely matches your skill set. Please go through the job description below and let me know if you or anyone who is looking for a good opportunity. You can reach me on. Job Title: Fraud SME Location: Hybrid inMalvern, PA(2 days from home and 3 days in office) Type: Full Time Permanent This is a Hybrid - 3 days Onsite Strong experience working with fraud detection, fraud strategy, and fraud prevention, with hands-on working experi
Easy Apply
Posted 14 hours ago | Updated 14 hours ago

AWS Engineer

Axiom Global Technologies, Inc.

•

Remote

Contract

We're looking for a talented and experienced Senior AWS Engineer to join our team. In this role, you'll be instrumental in designing, developing, and implementing robust and scalable backend solutions, with a strong focus on data processing, API development, and AWS cloud infrastructure. If you're passionate about building high-performance systems and have a solid understanding of modern cloud architectures, we encourage you to apply! Key Responsibilities: Design and develop data-driven solutio
Easy Apply
Posted 16 days ago | Updated 15 days ago

Resident Solution Architect

Cycle 3 IT Staffing

•

Remote

Contract

Cycle3 IT Staffing is seeking several Resident Solutions Architects who are SENIOR LEVEL for a REMOTE role. Architecting and Leadership: o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh. Data Engineering: o Strong programming experience in Python; Scala is a significant plus. o Proficiency in complex query tuning. o Experience building Slowly Changing Dimensions (SCD) TYPEs. o Familiarity with DBT. o Experience with structured streaming
Easy Apply
Posted 25 days ago | Updated 8 days ago

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera

Buxton Consulting

•

Remote

Contract

Machine Learning Artificial Intelligence Engineer with Big Data and Cloudera Location Fully Remote Must Haves- Strong project experience in Big Data platform with Amazon Web Services and Cloudera Data Platform is must. Strong experience with REST API development using Python frameworks (Django, Flask etc.) is must. Micro Services/Web service development experience using Spring framework is must. 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Good project e
Easy Apply
Posted 45 days ago | Updated 1 day ago

Databricks Data Engineer

Randstad Digital

•

Remote or Cleveland, Ohio, USA

Full-time

job summary: We are seeking a experienced Databricks Data Engineer with expertise in data engineering, big data, and cloud solutions. The ideal candidate will have hands-on experience with on-prem to AWS private cloud migrations, Databricks PVC-to-SaaS migration, and modern data stack components such as S3, Spark, Airflow, Lakehouse architectures, and real-time databases. Proficiency in Collibra, Starburst, relational and NoSQL data stores, and expertise in data modeling techniques like star an
Posted 1 day ago | Updated 2 hours ago