apache spark Jobs in philadephia, pa

Refine Results
21 - 40 of 321 Jobs

Data Engineer

Innova Solutions, Inc

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza

BI Manager

KPI Partners, Inc.

Philadelphia, Pennsylvania, USA

Full-time

KPI Partners, A global consulting firm focused on strategy, technology, and digital transformation. We help companies tackle their most ambitious projects and build new capabilities. We provide solutions in Cloud, Data, Application Development & BI spaces. We enable your growth At KPI, you can become who you want to be and learn skills that will take you further in your career Continuously upgrade yourself Develop as a future leader Drive cloud enablement around the world Engineering Excellence

Databricks Architect

Amiseq Inc.

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg

Data Engineer Hybrid- multiple locations (DFW area, Central Florida, King of Prussia, PA, Stratford, CT, Denver, Marietta, GA)

Calance

King of Prussia, Pennsylvania, USA

Contract

Description:Your Mission: As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakehold

ETL Talend Developer

Avance Consulting

Remote

Full-time

6+ years of Experience in Data Integrations,ETL, DWH. Hands on 3 Yrs experience on FiveTran/HVR. Hands on 3Yrs experience on Talend. Knowledge on AWS and Data pipelines . Knowledge on AWS Redshift & S3. Knowledge on python and spark would help.

Data Architect V

Aditi Consulting

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d

Data Migration Engineer

Kforce Technology Staffing

Wilmington, Delaware, USA

Contract

RESPONSIBILITIES: Kforce's client is seeking multiple candidates for a Data Migration Engineer role in Delaware, Eastern Maryland and near Philadelphia. Roles and Responsibilities * Configure and set up the AWS platform environment to meet organizational requirements and stage for eGain migration * Ensure that the platform is optimized for performance, security, and scalability * Provide technical support, write python widgets and troubleshooting during the setup phase to address any issues tha

Technical Architect

MSquare Systems Inc.

Remote

Full-time

Position: Remote & Full-TimeKey Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environme

Databricks Architect

Showman Staffing

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level: 10+ Years About the Role:-We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure arch

Data Engineer

Veeva Systems

Philadelphia, Pennsylvania, USA

Full-time

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead. At the heart of Veeva are our values: Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company - we made history in 2021 by becoming a public benefit corporation

Database ETL Test Engineer

Federal Reserve Bank of Philadelphia

Philadelphia, Pennsylvania, USA

Full-time

Company Federal Reserve Bank of Philadelphia The Federal Reserve Bank of Philadelphia is one of the 12 regional Reserve Banks that, together with the Board of Governors in Washington, D.C., make up the Federal Reserve System. It helps formulate and implement monetary policy, supervises banks and bank and savings and loan holding companies, and provides financial services to depository institutions and the federal government. The Federal Reserve Bank of Philadelphia serves eastern and central P

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

Senior/Lead Data Engineer , Remote, $63/HR

FASTRA LLC

Remote

Contract

Job Title: Senior/Lead Data Engineer Location: Remote Duration: 12 Months Responsibilities: Collaborate with cross-functional stakeholders (including data scientists, analysts, and business teams) to define data requirements, processing needs, and analytics solutions.Create and sustain scalable data models and efficient extraction processes.Establish and monitor data quality checks and validation systems.Construct and enhance business intelligence dashboards.Produce comprehensive documentation f

Site Reliability Engineer

Judge Group, Inc.

Wilmington, Delaware, USA

Contract

Location: Wilmington, DE Salary: $55.00 USD Hourly - $65.00 USD Hourly Description: Job Title: Site Reliability Engineer Location: Wilmington, DE (Onsite) Job Type: Contract to Hire (W2 only) Job Description: Client is seeking a Site Reliability Engineer for an onsite contract-to-hire position in Wilmington, DE. The ideal candidate will have extensive experience with AWS, Spark, PySpark, Python, and SQL. Must-Have Qualifications: Minimum 5 years of experience with AWS, Big Data, Spark, and S

Druid Engineer

Biztec Global LLC

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in

Machine Learning Engineer | Only W2

TekDallas

Remote

Contract

Position: Machine Learning Engineer Location: 100% Remote (EST time zone) Duration: 12 Month Contract Only W2 Qualifications: 10+ years of IT experience and at least 5+ years working as a Machine Learning EngineerMust have strong programming skills in PythonExperience with both RDBMS and NoSQL databases (e.g., MongoDB, BigQuery)Hands-on experience with data preprocessing, feature engineering, and model evaluationExperience working with cloud platforms, especially Google Cloud Platform (Googl

Snowflake developer

iPeople Infosystems LLC

Remote

Full-time

Role: Snowflake developer Location: Remote Type: Fulltime Job description This position is responsible for development/support of Enterprise data processing systems through enhancement of related software and processes. Develops software and procedures that improve processing capabilities. Analyzes, codes, tests, and implements in coordination with management, associates, and end users. Serves as production system support by resolving issues and ensuring ongoing functionality. May oversee th

Data Engineer III - Cybersecurity Technology Resiliency

JPMorgan Chase & Co.

Wilmington, Delaware, USA

Full-time

Job Description Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team. As a Data Engineer at JPMorgan Chase within the Cybersecurity Technology Resilience department, you serve as a seasoned member of an agile team to design and deliver trusted data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. You are responsible for developing, testing, and maintaining critical data pipelines and architectures acro

AIOps Google Cloud Platform Engineer - W2

DynPro Inc.

Remote

Contract

ONLY W2 Role: AIOps Google Cloud Platform Engineer Location: Remote, USA Duration: 12-month contract About the Role: Google Cloud is at the forefront of innovation, empowering businesses with cutting-edge cloud technologies. As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimi