apache spark Jobs in pennsylvania

Refine Results
241 - 260 of 312 Jobs

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth

Data Engineer

Charter Solutions Inc.

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API

Sr. Data Engineer With strong Google Cloud Platform Background

Cogent IBS, Inc

Remote

Full-time, Third Party

No profile will be consider without below skils Primary Skills- PySpark, Spark, Python, Big Data, Google Cloud Platform, Apache Beam, Dataflow, Airflow, Kafka and BigQuery Good to Have: GFO, Google Analytics Google Cloud Platform Experience Data Engineering and ecommerce is must Java/JavaScript with Data flow Need Shopify or Similar ecommerce platform Experience is must- Beam and Java Apache Beam and Java Dataflow and Java Google Cloud Platform and Java

Senior Big Data Engineer - W2ONLY

Cyma Systems Inc

Remote

Contract

We are seeking an experienced Big Data Engineer with a strong background in *Java and AWS* to join our dynamic team. The ideal candidate should have: 6+ years of overall experience in software development. experience working with *Java* and Object-Oriented Programming *(OOP)* principles. Experience with *distributed systems.* experience in designing and developing *RESTful APIs.* experience working with Big Data technologies. experience in *AWS cloud* services. Proficiency in *Apache Spark* and

Data Architect: III (Senior)

Randstad Digital

Remote or Madison, New Jersey, USA

Contract

job summary: The Senior Data Engineer is responsible for designing and developing scalable, high-performance data solutions to support millions of users and clients. The role requires expertise in big data technologies such as Spark with Scala, Kafka, NoSQL databases, and AWS cloud services, with a focus on building robust data pipelines and platforms in a fast-paced, collaborative environment. Candidates should have extensive experience in real-time stream processing, data architecture, and a

Google Cloud Platform Engineer

Ethires LLC

Remote

Contract

Job Title: Google Cloud Platform Engineer Location: Remote Contract: 6+ months Contract To Hire Job Description The incumbent is responsible for the definition, development, and implementation of new systems, and major enhancements to existing systems, as well as production support for systems with high complexity. The incumbent is capable of providing project leadership for major feasibility or business systems analysis studies. Required Qualifications: Bachelor's Degree or additional years of

Google Cloud Platform Engineer

SGS Consulting

Remote

Contract

Title: Google Cloud Platform Engineer Location: 100% Remote Job ID: Google Cloud Platform0513 Job Duration: 06 Months (High Chances of Extension) The incumbent is responsible for the definition, development, and implementation of new systems, and major enhancements to existing systems, as well as production support for systems with high complexity. The incumbent is capable of providing project leadership for major feasibility or business systems analysis studies. Required Qualifications: Bachel

Senior Big Data Engineer With JAVA and AWS

Cyma Systems Inc

Remote

Contract

Title: Senior Big Data Engineer With JAVA and AWS Location: Remote, PST hours We are seeking an experienced Big Data Engineer with a strong background in Java and AWS to join our dynamic team. The ideal candidate should have:6+ years of overall experience in software development.experience working with Java and Object-Oriented Programming (OOP) principles.Experience with distributed systems. experience working with Big Data technologies.experience in designing and developing RESTful APIs.experi

Google Cloud Platform Engineer

Dew Softech Inc

Remote or Pittsburgh, Pennsylvania, USA

Full-time, Part-time, Contract, Third Party

Google Cloud Platform Engineer Location : Remote Duration: 6+ contract Job Summary: Top 3 Skills - Knowledge of Google Cloud Platform environment, Terraform development exp, and database modeling exp Job Description: The selected candidate will be responsible for the definition, development, and implementation of new systems, and major enhancements to existing systems, as well as production support for systems with high complexity. What You'll Do Utilize expertise in Google Cloud Platform (

Sr. Data Analyst

Computer Enterprises, Inc.

Pittsburgh, Pennsylvania, USA

Contract

Job Title: Senior Data AnalystLocation:Dallas, TX; Pittsburgh, PA; hybrid Position SummaryThe Senior Data Analystrole is ideal for individuals who excel at analyzing complex data, translating business needs into technical solutions, and collaborating across teams to drive data-driven decision-making. Key Responsibilities ConductUser Acceptance Testing (UAT)and performin-depth data analysisto support business initiatives. Collaborate with business and technology partners to: Gather and document b

Big Data Developer

URSI Technologies Inc.

Remote

Contract, Third Party

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr

Data Engineer

DVARN

Remote

Contract

Position: Data Engineer Location: 100% remote Must Haves: Python & PySpark (Spark SQL) 3+ years Airflow (or any orchestration tool) 2+ years Google Cloud Platform (BigQuery, GCS, Pub/Sub, Cloud Run, Functions, Cloud SQL) 3+ years Real-time data ingestion (Kafka, webhooks, file-based) 2+ years API integration (REST/webhooks) 2+ years Kubernetes (GKE preferred) 1 2 years BigQuery SQL & PostgreSQL 2+ years YAML/config-driven pipeline design 2+ years Schema transformation, hashing, DQF 2+ years CI

Full stack Engineer

Prism IT Corp

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex

Azure Data Engineer Consultant

Korn Ferry

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows

Google Cloud Engineer Terraform development exp

Zenosys

Remote

Contract

Hello, Zenosys is looking for Google Cloud Platform Engineer client Remote Work If you are available and interested in the below opportunity, please send me updated resume. Thanks Job Title Google Cloud Platform Engineer Location- Remote Work Duration 12+ Months Contracts Highly Chance to Extend If you are interested, please provide the following details along with the updated resume to speed up the interview process. Full Legal Name as mentioned in Drivers' license: Current Location: Willing t

Data Engineer

Dahl Consulting

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,

Senior Data Analyst

Computer Enterprises, Inc.

Pittsburgh, Pennsylvania, USA

Contract

Senior Data Analyst W2 Contract Hybrid (3 days on site 2 days remote) Pittsburgh/Dallas/Cleveland Key Responsibilities: Conduct UAT (User Acceptance Testing), exploratory data analysis, and root cause investigations. Gather and translate complex business requirements into technical documentation and logic. Develop lightweight coding solutions in SQL, Python, and/or Spark to support business rules and data transformations. Partner with business and technology teams to prototype and implement data

Google Cloud Platform Architect

Estuate Inc.

Remote

Contract, Third Party

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected

Palantir Engineer

CX Data Labs Pvt Ltd

INT, USA

Full-time, Contract

Palantir Engineer South America Fulltime/Contract Key Responsibilities: Design, develop, and maintain data pipelines and ETL workflows within Palantir Foundry and/or Gotham. Collaborate with data scientists, analysts, and stakeholders to understand data needs and deliver scalable solutions. Integrate and transform data from various sources into usable formats using best practices in data engineering. Optimize performance and reliability of data pipelines and workflows. Contribute to data modell

Palantir Foundry Developer / Data Engineer

GreyMatter Solutions

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp