apache spark Jobs

Refine Results
1,941 - 1,960 of 2,191 Jobs

Sr Platform Engineer

Reliable Software Resources

•

Seattle, Washington, USA

Contract

Position: Sr Platform Engineer Location: Seattle, WA Contract: 6+ months Required Skills: Python, Platform engineering, Infrastructure As Code, Automation Must have a software engineering/problem solving background. Job Requirements: 8 years software engineering 4+ years of software engineering in App Dev capacity 4+ years of automation and scripting using Python 8+ years of experience building automation/configuration management infrastructure such as Ansible, Terraform, Chef, and/or Puppet 8+
Easy Apply
Posted 1 hour ago

Azure Data Bricks Architect

iTech US, Inc.

•

Tampa, Florida, USA

Third Party, Contract

Job Role: Azure Data Bricks Architect Location: Tampa, FL Duration: 12+ months Job Description: Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).Work with stakeholders to develop modern data architectures that meet business requirements.Lead the migration from legacy platforms to the Databricks Lakehouse architecture.Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.
Easy Apply
Posted 2 days ago | Updated 1 day ago

Lead Databricks Architect

Nityo Infotech Corporation

•

Jersey City, New Jersey, USA

Contract, Third Party

Role : Lead Databricks Architect Location : Iselin NJ : Hybrid (2-3 Days) Local candidates only Exp level : 15 years+ Must have : Expert in Databricks , Pyspark , python, SQL JD: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and proficiency in pyspark. Cloud platform: Preferred Azure
Easy Apply
Posted 19 days ago | Updated 13 days ago

Sr/Lead Python Developer Engineer

Apex 2000

•

Calgary, Alberta, Canada

Contract

Hi, Hope you doing well. This is Karthik Danmola and I am Lead Resource Manager from Apex-2000 Inc. So, I am reaching out to you on an exciting Job Opportunity with one of our clients. Job Title: Sr/Lead Python Developer Engineer Location: Calgary, AB, Canada (Hybrid model Role) Client: Confidential Contract Base Job Urgent Requirement Job Description: Python Primary. 6-8 years of experience.Added and necessary: Airflow, Kubernetes, ELK, Flask / Django / Fast API 3 years exp.Almost very importan
Easy Apply
Posted 8 days ago | Updated 8 days ago

ETL Data Engineer_ Jersey City, NJ

Sripen

•

Jersey City, New Jersey, USA

Contract, Third Party

Job Description: 8+ yrs. in Azure Databricks technologies.Good understanding of ETL, BI and DW technologies.Hands-on experience on JSON or XML files as sources.Experience in autoloader for incremental loading and explode options for flattening dataExperience in loading Delta live tablesExperience in PySpark or Spark using data frames.Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.Work together with data scientists and analysts to under
Easy Apply
Posted 1 hour ago

Databricks / AWS Developer

Thunderhawk Technology Partners

•

Boston, Massachusetts, USA

Contract

Databricks / AWS Developer Location: Boston, MA - 4 days onsite Duration: 6 months* 10+ years of overall IT experience * 5+ years of hands on experience in cloud-based development(Databricks with AWS cloud services) and integration * Extensive experience in Java, J2EE and Python * Solid tech skillset/experience in Big Data/Data Model, PySpark * Strong knowledge on Spark technology - Data engineering pipeline * Strong Experience in complex SQL * Experience working in an agile delivery environment
Easy Apply
Posted 19 days ago | Updated moments ago

Java Developer

Acro Service Corp.

•

Reno, Nevada, USA

Contract

Looking for Local candidates only in Carson City or Reno or Spark, NV Please do not send resume if you are not local to NV. Jave Developer Experience and Skills Required-Minimum of 5 years developing in Java 1.8 Minimum of 5 years developing SQL Minimum of 5 years developing using common web development languages (HTML, CSS, JavaScript, etc.) Minimum of 5 years developing using Angular Minimum of 5 years developing using Spring Boot Experience and Skills Preferred-Java development Software desi
Easy Apply
Posted 27 days ago | Updated 27 days ago

Data Engineer (ETL/DB)

TekShapers

•

Fort Mill, South Carolina, USA

Full-time, Part-time, Third Party, Contract

Data Engineer (ETL/DB) (Financial industry / Wealth Management domain) Duration 6-12 Months Location - Fort Mill, SC Main Skills ETL Proficiency, AWS Glue Services, Database Management, DevOps Practices JD AWS Glue (ETL scripting, job orchestration, crawlers) PySpark/Scala for Glue jobs AWS IAM, S3, CloudWatch Experience with Sqoop to Glue migration Understanding of EMR and Spark job lifecycle MongoDB data modeling and connectors Knowledge of building and maintaining serverless applicatio
Easy Apply
Posted 21 hours ago | Updated moments ago

Data Cloud Engineer

Strategic Staffing Solutions

•

Charlotte, North Carolina, USA

Contract

Data Cloud Engineer Charlotte, NC 12 Month Contract On Site 5+ years of software engineering experience 3+ years of experience working with Teradata 3+ years ETL AbInitio 3+ Advanced SQL 1 + years of cloud computing experience 1+ years of experience with Google Big Query Other Qualifications 3+ years of experience with Spark, python 3+ years of experience with secure DevOps and deployment automation to cloud environments 3+ years of Agile experience Strong analytical skills Strong verbal, writt
Easy Apply
Posted 20 days ago | Updated 2 hours ago

Sr Data Engineer (Public-Trust)

My IT LLC

•

Ashburn, Virginia, USA

Full-time, Contract

Job Title: Sr Data Engineer (Public-Trust) Location: Ashburn, VA (Onsite) Duration: 12 Months+ Exp. Level: 8-12 yearsJob SummaryWe're hiring a Sr Data Engineer to join a long-term federal program supporting high-impact, mission-driven data initiatives. This is a hands-on, engineering-heavy role that requires deep technical expertise and a strong commitment to on-site work in Ashburn, VA.Security Clearance: Public Trust Clearance is must. What You'll Do: Build and maintain high-volume data
Easy Apply
Posted 8 days ago | Updated moments ago

Senior AWS Data Engineer with Financial Investment Banking Expertise

ITECS

•

Fort Mill, South Carolina, USA

Third Party

Position: Senior AWS Data Engineer with Financial Investment Banking Expertise Location: Fort Mills, SC (Onsite Hybrid 3 days a week ). Local candidates preferred. Job Summary: Contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. Be part of a dynamic team, building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-
Easy Apply
Posted 13 days ago | Updated 3 hours ago

Senior AWS Data Engineer

Agile Enterprise Solutions, Inc.

•

New York, New York, USA

Contract, Third Party

Role: Senior AWS Data Engineer Job Location: Fort Mills, South Carolina (Hybrid 3 Days Onsite) Duration: 12+ Months Hiring- Contract Job Summary: Contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. Be part of a dynamic team, building data solutions in a supportive and hybrid work environment. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will d
Easy Apply
Posted 13 days ago | Updated 9 days ago

Frontend Developer - UI Design Systems

Triumph Tech

•

Surprise, Arizona, USA

Full-time

Since its release in 2014, Spark s initial project Rock RMS has been leading the innovation curve of the Church Management Space. Hundreds of ministries have been impacted by this opensource revolution. It s amazing what God has done, and we believe He s just getting started. This position is a key hire that will allow Spark to take Rock to the next level by owning and evolving our frontend design system in code. You ll be part of the development team, responsible for maintaining reusable UI/CSS
Posted 12 days ago

Data Engineer

Rezult Group, Inc

•

Remote

Full-time

This individual will be responsible for: Designing robust, componentized, and adaptable processes to scale-up our business intelligence platform.Understanding big data and cloud technologies and quickly become productive with, and provide analysis on these toolsHaving strong SQL experience and the ability to work with cloud infrastructure programs, OOD, and data pipelinesIdentifying inefficiencies in code or processes and recommend solutions.Being able to adapt quickly to changing requirements a
Easy Apply
Posted 15 days ago

Azure Data Engineer

Acadia Technologies, Inc.

•

Las Vegas, Nevada, USA

Full-time

Technical Skills:Azure Services:Deep understanding and experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure Databricks, Azure SQL Database, Azure Cosmos DB, and other relevant Azure data services. Data Warehousing and Data Lakes:Knowledge of designing, implementing, and managing data warehouses and data lakes on Azure. ETL Processes:Expertise in developing and maintaining ETL (Extract, Transform, Load) pipelines using tools like Azure Data Factory. Progr
Easy Apply
Posted 5 days ago | Updated 5 days ago

Python Developer with hands-on experience in Artificial Intelligence and Machine Learning

TechSME Inc

•

Redmond, Washington, USA

Contract

We are seeking a highly skilled Python Developer with hands-on experience in Artificial Intelligence and Machine Learning to join our dynamic team. The ideal candidate will play a key role in building intelligent applications and scalable ML pipelines, working closely with data scientists, engineers, and product teams. Required Skills: Strong proficiency in Python and its ecosystem (NumPy, Pandas, Flask/FastAPI).Experience with AI/ML frameworks such as TensorFlow, PyTorch, Scikit-learn.Knowledge
Easy Apply
Posted 8 days ago

Sas lead and developer

Hexaware Technologies, Inc

•

Irving, Texas, USA

Full-time

Role : Sas lead/ developer Location : Irving, TX (Hybrid 3 days) Hire Type : Fulltime Job Description: Responsibilities:Analyze SAS programs to understand sources, dependencies, data flow.Sanitize SAS programs in preparation for conversion.Optimize SAS programs in preparation for conversion.Incorporate changes in accelerator to ensure generated code aligns to required standardsUtilize accelerator to convert SAS programs to PySpark programs.Demonstrate and document code lineage.Unit Test ge
Easy Apply
Posted 1 day ago

Data Engineer

MARKS IT SOLUTIONS LLC

•

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CA (Onsite) Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements to existing systems and participate in rot
Easy Apply
Posted 8 days ago

Machine Learning Engineer

Federal Soft Systems Inc.

•

Redwood City, California, USA

Full-time

Lead Machine Learning Engineer Hybrid 3 days/week onsite (Mon, Wed, Thurs) | Full-Time Location: Redwood City, CA Have to come from an e-commerce, e-market background think Etsy, Wayfair, TikTok, Instagram, Poshmark, Mercari, Depop, Shopify, Amazon, eBay, ThredUp, Vinted, Target, etc. (think social e-commerce, like apps you buy things from) Client is an e-commerce, community-driven marketplace. What You ll Do: - Build and deploy ML models on large-scale data - Lead algorithm development for b
Easy Apply
Posted 2 days ago | Updated 1 day ago

Data engineer - only local to Dallas TX

Intellisoft Technologies

•

Plano, Texas, USA

Contract

Role: Java Data engineer Location: Plano, TX | Hybrid Option Duration: 6-month open-ended Contract (no contract maximum)Required Qualifications: 8+ years of Java developer experience3+ data engineer expSolid experience writing clean, concise, tested, maintainable code in Java.Experience building and deploying applications in AWSAPI development experienceExperience utilizing Spark and SQLExperience with Databricks or EMRTerraformExperience with CI/CD and updating build pipelines and pipeline task
Easy Apply
Posted 36 days ago | Updated 2 days ago