Hadoop PySpark Data Pipeline Build Engineer Jobs in Philadephia, PA

Refine Results
21 - 40 of 115 Jobs

Azure Data Engineer

Techmatic Inc

Remote

Contract, Third Party

Job Details: We need an Azure Data engineer that has very strong Azure Data Bricks experience along with the typical Azure data stack tools like Data Factory, Synapse, etc. as well as SQL and tools like PySpark. Any experience with Fabric is a huge plus as the team will be utilizing Fabric on this project. Job Description: We are seeking a talented and experienced Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a pivotal role in designing, implementing, an

AWS Data Engineer

Allwyn Corporation

Remote

Third Party, Contract

Job Title: AWS Data Engineer Location: Washington D.C (Remote) AWS Hands On development, Extensive experience in cloud technologies for streaming platforms, with a focus on AWS services for data lake creation, orchestration, and analytics.Innovative problem solver with a demonstrated ability to develop intricate algorithms based on deep-dive statistical analysis, enhancing customer relationships, and personalizing interactions.Hands-on experience with cloud-based tools such as AWS EMR, EC2, Data

Azure Architect/ Azure Data Architect

Brilliant Infotech Inc.

Remote

Full-time

Role: Azure Architect/ Azure Data Architect Location: Remote Duration: Long term contract Note: We are unable to sponsor visa at this time. Job Summary: We are seeking a strong experienced Azure Data Solutions Architect. If you are data freak and looking for a professionally challenging and rewarding career this position might be of interest to you into the world of data. Azure Data Solutions Architect will spearhead new Data Driven initiatives IT Projects and Consulting services using Azure D

Lead Software Engineer - Python / AWS / ETL / Big Data

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer - Python / AWS / ETL / Big Data at JPMorgan Chase within the Consumer and Community Bank, Connected Commerce Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducti

Senior Data Engineer (W2 Remote)

Performix Business Services, LLC

Remote or Chicago, Illinois, USA

Contract

This is primarily an ETL data engineer position. For tools they will need to have Databricks and PySpark (for distributed ETL). They need to know python as that is the language used to deploy Databricks tasks.They will need to write pipelinesPerformance enhancement and awarenessMid-level person with 4-5 years of experienceLooking for a data engineer with Python and Databricks skill set. The job primarily involves writing and maintaining data pipelines for various Ag related datasets.It is a rem

Lead Software Engineer

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Global Data Aggregation and Control team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple t

Software Engineer

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

DESCRIPTION: Duties: Design, develop and implement software solutions. Solve business problems through innovation and engineering practices. Involved in all aspects of the Software Development Lifecycle including analyzing requirements, incorporating architectural standards into application design specifications, documenting application specifications, translating technical requirements into programmed application modules, and developing or enhancing software application modules. Identify or tro

Senior Cloud Engineer

InfoCepts LLC

Remote

Full-time

Position:Senior Cloud Data Engineer Purpose of the Position:As a Senior Cloud Data Engineer, this position requires candidate who are enthusiastic about data and driven to help in organization's AI & Analytics challenges. As a member of the team, you will help our clients on their data and analytics journey, by building data pipelines, improving consistency, and building the necessary infrastructure to support their analytics platform. Location: Remote - Any state in USA Type of Employment: Full

Sr. Lead Data Scientist

TEK FYNDER

Remote or Arkansas, USA

Third Party, Contract

Job: Sr. Lead Data Scientist Duration: 12 months contract Location: 100% Remote Top Skills: Airline Revenue Management experience is a must 4 to 6 yrs as Lea Google Cloud (Google Cloud Platform) that is the preference but other cloud experience will work. Programming- Python and C++ Data: PySpark Experience with Rally and JIRA is good. Job Description: SABRE CORPORATION is a leading technology provider to the global travel and tourism industry. Headquartered in Southlake, Texas, USA. we serve

IT Engineer (Data Engineer)

HawkB Inc

Remote

Full-time

Job Description: Job Title: IT Engineer (Data Engineer). Job Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction. Analyze cluster performance metrics and implement tu

Data Engineer

Raas Infotek LLC

Remote or Texas City, Texas, USA

Contract

Data Engineer Contract W2 only Responsibilities 9+ years of Data Engineering experience.Advanced experience working with both relational databases (e.g. Teradata, Vertica, etc.) and Big Data platforms (e.g. Hadoop, etc) requiredAdvanced hands-on experience with Python, Spark (PySpark, Scala) programming languagesStrong Hands-on Apache Spark Data frame and Datasets Map Reduce, Hive Query Language, HDFS, Hive.Experience with message queue technologies such as Kafka or RabbitMQDemonstrated experie

Machine Learning Lead Software Engineer

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Machine Learning Lead Software Engineer at JPMorgan Chase within the Consumer Community Banking, Operations Technology team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas withi

Senior Healthcare Data Engineer with Health Care Domain Exp(Minimum 12 Years)

Synkriom

Remote

Third Party, Contract

Overall 12+ in IT Experience.Minimum of 8+ years of experience in Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL, AWSRequired Domain: Healthcare/Insurance Candidate is expected to have experience in Shell scriptingExtensive data analysis skills and Good communication skills

Databricks Cloud Engineer, Sr. Consultant

Nanostax LLC

Remote

Contract

Required: 12+ years of relevant technology consulting or industry experience 3+ years of experience in Financial domain2+ years experience implementing data solutions on the Databricks Data Intelligence platform, to include Delta Lakes3+ years experience with SQL and Python2+ years experience leading workstreams or small teams, within complex technology engagements with resources in multiple locationsBachelor s Degree or equivalent professional experienceAbility to travel up to 50% on average, b

Lead Azure Engineer

GSPANN Technologies

Remote or Fremont, California, USA

Contract, Third Party

About GSPANN We work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world s most respected brands. We ve worked with more than 200 organizations and have served as a trusted business partner for some of the world s most respected brands. Our solutions have the businesses create custom-designed technology platforms, which have transformed the way our clients connect with their employees, partners, and customers. GSPANN is headquartere

Sr AWS Cloud Engineer

Rythmos

Remote or Dallas, Texas, USA

Third Party, Contract

Below is the JD for Sr Cloud Engineer role. Responsibilities: Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark. Evaluates and plans software designs, test results and technical manuals using AWS Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions. Create and review technical and user-focused documentation for data solutions (data models,

Lead Data Scientist Engineer

Pyramid Consulting, Inc.

Remote

Contract

Immediate need for a talented Lead Data Scientist Engineer. This is a 09+ Months Contract opportunity with long-term potential and is located in Dallas, TX (Remote). Please review the job description below and contact me ASAP if you are interested. Job ID:24- 21314 Pay Range: $80 - $85/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Understanding of airlin

Data Engineer

TalentBridge

Remote or St. Louis, Missouri, USA

Contract

Data EngineerConnecting People with Their PurposeAt TalentBridge, we know success begins with personal connections, and our goal is to fully understand your values, motivations, and passions, then to connect you with companies whose values and motivations match your own.Whether you're looking for temporary employment or a full-time career, the TalentBridge family is here to help.About the RoleWe're looking for a talented Data Engineer to join one of our Global 500 clients and be part of a growin

Urgent Opening - ETL Tester with Healthcare domain experience - REMOTE

Infinite Computer Solutions (ICS)

Remote

Full-time

Hi Dear, Please let me know your interest for the below mentioned requirement: Role: ETL Test Lead/Engineer with Healthcare domain exp Location: REMOTE Duration: Permanent/Fulltime/Contract Note: Only Independent candidate are eligible. Roles and Responsibilities: Must HaveAt least 10+ years of work experience in Quality Engineering (Testing) in Data platformsPreferred healthcare domain experienceExperience in leading and testing large scale, complex Data Modernization initiativesLed Data Platfo

Software Engineer III, Machine Learning and Cloud Engineering

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer , Machine Learning and Cloud at JPMorgan Chase within the Consumer and Community Banking, Machine Learning Delivery Americas team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutio