apache spark Jobs

Refine Results
1,981 - 2,000 of 2,021 Jobs

Senior Staff Machine Learning Engineer, Relevance and Personalization

Airbnb

No location provided

Full-time

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Join Airbnb's Relevance and Personalization team, where you'll have a unique opportunity to shape the discov

Data Engineer (Spark/Scala/Python)

XTGlobal

Virginia, USA

Contract

Data Engineer * Hybrid in Richmond Only W2 consultants. 5+ years of experience in at least one of the following: Java, Scala, Python/PySpark, SQL or Go 3+ years of experience with AWS, specifically EMR 3+ years of experience in open source frameworks Experience building high-volume data interactions and observability/monitoring tools will be a huge plus Required Skills : Spark Python, Java, or Scala EMR SQL MQ experience (Kafka, Kinesis, etc.) Please share resumes to

Python Full Stack developer

SIAL TECHNOLOGY PARTNERS

Nashville, Tennessee, USA

Contract

Python Full Stack Engineer Location: Nashville, TN (on-site in office 3 days a week) We're seeking a strong Python full stack developer with a focus on back-end and parallel programming skills, and with an emphasis on taking ownership of systems and introducing new innovations. The back-end technologies include Python, Flask, React, Snowflake, ETL, Kubernetes, GitHub, ETL, AWS, Azure: Strong knowledge of Python programming language and its frameworks, with a focus on back-end development.Experi

Data Engineer (AWS & Python)

Commercial Programming Systems, Inc.

Los Angeles, California, USA

Full-time

Data Engineer - (AWS & Python) Our client is an investment advisor that builds algorithmic strategies based on proprietary quantitative factor research. Remote work is authorized. Summary As a member of the Technology Services Team, the Senior Data Engineer will participate in the design and development of sophisticated data management systems, data science driven analytics and algorithmic trading platforms. This person will implement and maintain these processes in both internally hosted data c

scala developer

Rivi Consulting Group

New York, New York, USA

Full-time

Scala developer Location: Midtown Manhattan New York, NY Hybrid 2 - 3 days/week We would like to hire hands on Scala developer that will be responsible for delivering a high quality code in a big data platform, Unit testing in automated test framework, automated DevOps release and documentation of technology solutions for transaction monitoring, customer activity review, Optimization of scenarios and other associated transformation activities. Candidate will be collaborating with senior stakehol

AI/ ML Engineer

Resource 1

Remote

Contract

Resource 1 is in need of an Artificial Intelligence (AI)/ Machine Learning (ML) Engineer for a long-term, remote contract position. Responsibilities: Architect, build, maintain and improve new and existing suite of algorithms and their underlying systemsImplement end-to-end solutions for batch and real-time algorithms along with requisite tooling around monitoring, logging, automated testing, performance testing and A/B testingEstablish scalable and efficient automated processes for data analyse

Data Engineer with Palantir

InfoVision, Inc.

Richardson, Texas, USA

Contract

Skills: 10+ years of IT experience.Strong Experience with programming languages using Python and SQL is must.Strong Experience with Palantir foundry software is must.Strong experience in analyzing large data set and resolve issues.Strong experience in Data Mining and data integrationUsing Ingested Data from Real time streaming KafkaExperience delivering ETL, data warehouse and data analytics capabilities on bigdata architecture such as HadoopExperience with schema design and dimensionKnowledge o

Need AWS Lead Data Engineer at Portland, OR (Onsite) (Full Time)

Agile Enterprise Solutions, Inc.

Portland, Oregon, USA

Full-time

Job Title : AWS Lead Data Engineer Location : Portland, OR (Onsite) Duration : Full Time Mandatory Skills: Python, Pyspark, SQL, AWS ENR, AWS Redshift Job Description : Roles and Responsibilities: 9+ years relevant work experience in the Data Engineering field 6+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.) 6+ years of experience Strong experience with relational SQL and at least one programming language such as Python,

Urgent Fulltime job opening for the role of .Net Architect in Minneapolis, MN/ Chicago, IL/ Irving, TX/ Atlanta, GA (Must be in Office from Day 1)

Q1 Technologies, Inc.

Irving, Texas, USA

Full-time

Role: .Net Architect Location- Minneapolis, MN/ Chicago, IL/ Irving, TX/ Atlanta, GA (Must be in Office from Day 1) Duration:- Permanent/ Fulltime Job Description: Roles & Responsibilities Solution and Application Architecture role (7+ years) coming from an Application/Solution/Technology Architect background. Must Have skills MS .NET and .Core Framework, REST, Microservices, Kubernetes, Docker Microsoft SQL Server RDBMS, Oracle RDBMS, large/complex datasets, data modeling, and performance tun

BigData Spark Developer

Triveni IT

Tampa, Florida, USA

Full-time, Contract

Triveni is a technology company located in the New York City area. Triveni utilizes agile technologies to develop solutions for our clients. We are seeking highly motivated engineers to join our team. The successful candidate will focus on the engineering and development of complex business requirements. We provide a casual work environment where hard work is rewarded. Role: BigData Spark Developer Location: Tampa, FL Type: FTE Visa- Citizens and those who are authorized to work can apply fo

Sr. Java Tech Lead

Triveni IT

Pleasanton, California, USA

Contract, Third Party

Triveni is a technology company located in the New York City area. Triveni utilizes agile technologies to develop solutions for our clients. We are seeking highly-motivated engineers to join our team. The successful candidate will focus on the engineering and development of complex business requirements. We provide a casual work environment where hard work is rewarded. Job Title- Sr Java Tech Lead Location -Pleasanton, California Duration - 12 months plus Experience- 10-12 years Visa- This p

Senior Data Engineer

iSpace, Inc

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P

Sr. Solution Architect - Healthcare

Exl Service

Remote

Full-time

The Architect Consultant provides leadership and technical expertise in requirements identification, data modeling, data movement and transformation mapping (source to target), automation and testing strategies and translating business needs into technical solutions with adherence to established data guidelines and approaches from an enterprise perspective. The Architect consultant understands and leverages best-fit technologies and approaches that align with business goals and environmental cha

Data Warehouse Architects / Engineers

TECH Tammina

New York, New York, USA

Contract, Third Party

Job Title: Data Warehouse Architects / Engineers Location: NYC, NY Experience: 14+ years in the IT industry. 8+ years working with US companies in the US. 8+ years as a Data Architect/Engineer. 5+ years of recent experience (since 2015) in a major banking or brokerage house environment. 6+ years with Informatica and Azure. 6+ years designing and implementing ETL processes using SQL, ETL tools, and Linux shell scripting. 4+ years with AWS. 7+ years of programming experience with Python. Experie

Hybrid :: Python Developer :: W2 Position

Softsages LLC

Plano, Texas, USA

Contract

Dear Abhay, We are delighted to reach out to you on behalf of SoftSages Technology, a rapidly expanding IT and staffing company headquartered in Malvern, PA. We take immense pride in serving critical clients across various sectors, including federal, commercial, and healthcare industries. Our commitment to excellence extends beyond just our clients, as we firmly believe that our consultants are equally vital to our success. We are currently seeking dynamic individuals like yourself to join our

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

100% REMOTE Full-time Role: Sr. Databricks/Data Engineer with "Databricks Certified Data Engineer". Location: 1775 Tysons Blvd, Tysons, VA (REMOTE)

Satsyil Corporation

Remote

Full-time

Role: Sr. Databricks/Data Engineer with "Databricks Certified Data Engineer" & AWS, Python, Pyspark.Location: 1775 Tysons Blvd, Tysons, VADuration: Full-timeJob Description:Satsyil Corp is currently seeking a highly skilled and motivated Sr. Databricks/Data Engineer with "Databricks Certified Data Engineer" to join our team and contribute to the success of our Enterprise Data Services project. As a Databricks Architect, you will play a crucial role in developing and optimizing Spark applications

Azure Data Lake Principal Architect

Saxon Global Inc.

US

Full-time

Hi, I hope, you are doing great. Title: Azure Data Lake Principal Architect Location: Somerville, MA(Hybrid) Duration: Fulltime Hybrid Position 1-2x a week onsite in Somerville, Massachusetts Candidate needs to have experience doing solution architecture on Azure. The Architect will play a crucial role in designing, developing, and maintaining our data infrastructure and platform integration solutions. Responsible for advancing our data engineering capabilities, ensuring data quality, and cont

Actimize Developer

Saxon Global Inc.

Bay St. Louis, Mississippi, USA

Contract

Job Title: Actimize Developer Location: Jackson MS (Remote Also Fine) Job Overview: As an Actimize Developer, you will be responsible for designing, developing, and maintaining Actimize-based solutions to effectively mitigate financial crime risks and ensure regulatory compliance within the organization. You will collaborate with stakeholders such as compliance officers, risk managers, and IT teams to understand requirements and implement solutions that meet business needs. Key Responsibilitie

AI Developer

ConsultNet, LLC

New York, New York, USA

Full-time

Job Description: As a Mid-Level AI Developer, you will be responsible for designing, developing, and deploying AI models and algorithms. You will work closely with cross-functional teams to create intelligent systems that drive business value and improve user interactions. Key Responsibilities: Design, develop, and implement AI models and algorithms to solve complex problems. Collaborate with data scientists, software engineers, and product managers to integrate AI solutions into existing syste