Apache Spark jobs in Pennsylvania

Remote

•

5d ago

Big Data Architect | Location: Remote | Full Time Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation. Job DescriptionHandson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data

Easy Apply

Full-time

Depends on Experience

Java Spark Developer - Associate Vice President

Remote or Jersey City, New Jersey

•

Today

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Full-time

USD 121,200.00 - 181,800.00 per year

COBOL Developer

Remote

•

3d ago

JOB TITLE: COBOL Developer START DATE: ASAP DURATION: FTE WORK HOURS: Full time, 40 hours/ week LOCATION: Remote (WA, OR, ID, MT, CA, NV, AZ, AK preferred/ possibly TX, FL) TRAVEL: N/A EQUIPMENT/ ACCESS: Provided upon start Summary: We are seeking an experienced engineer to support TMF implementations in SQL-based environments. The ideal candidate will bring strong expertise in TACL scripting, MX/MP SQL, and have exposure to modern integration tools and platforms such as Kafka, ULinga, and Spa

Easy Apply

Full-time

$115 - $125

Data Engineer with Python Development

West Chester, Pennsylvania

•

3d ago

Good experience in Python/PySpark Programming (must), Databricks, Rundeck, spark clusters, SQL experience is must Good to have Scala Proven experience (5+ years) as a data engineer and data scientist, preferably in a fast-paced technology or analytics-driven environment. Telecom Domain must. Big Data / ETL Development background needed. Cloud Technologies - AWS S3, AWS Athena SQL - Hive,Teradata,Spark SQL

Easy Apply

Full-time

$50 - $60

Data Architect

Hybrid in Reading, Pennsylvania

•

2d ago

We are seeking an experienced Lead Data Architect to design and deliver next-generation, event-driven data architectures and real-time streaming systems. This role requires deep hands-on expertise with Apache Kafka, Apache Spark Structured Streaming, Apache Flink, messaging queues, and building highly resilient IoT data platforms on AWS. Key Responsibilities Lead and mentor a team of data architects and engineers. Define and execute data architecture strategies aligned with business objectives.

Easy Apply

Contract

Depends on Experience

Big Data Technology Architect

Remote or New York, New York

•

Today

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c

Full-time

USD 132,500.00 per year

Sr Data Architect

Remote or Hybrid in McLean, Virginia

•

3d ago

Senior Data Architect Remote Longterm.W2 only ( Please don't apply CTC candidates !! ) Need Strong Databricks , PySpark Experience -Senior level Big Data Architect - 5+ Years experience in Solutions Architecture -Python, Spark, AWS and experience working with data pipelines -EMRs

Easy Apply

Contract

Depends on Experience

Data Architecture Team Lead

Pennsylvania

•

Yesterday

Position3 : Data Architecture Team Lead Location : Reading, PA (*Local Only, in office 3+ days a week) Contract to Hire Team Leadership & Strategy Lead and mentor a team of data architects and engineers. Define and drive the data architecture strategy aligned with business goals. Collaborate with stakeholders across engineering, product, and business teams. Architecture & Design Design scalable, secure, and high-performance data architectures. Develop data models, data flow diagrams, and

Easy Apply

Third Party

Senior ETL/Data Engineer_10+years experience

Remote

•

4d ago

100% RemoteWork EST hoursNeed a Sr. Resource who can articulate and perform at a high level on camera with heavy SLACK activity. Client: LifeStanceEngagement: 2+ years Need them to start ASAAPAny Citizenship Vendors: I prefer No layers please, please screen for good video and communication presence, fake candidates will get you taken off my distro send you best 1 or 2 Must be a Data Engineer with a strong background in AWS Glue, PySpark, Python, Healthcare EMR, and AWS Step Functions. 7+ yea

Easy Apply

Contract, Third Party

Depends on Experience

Lead Data Engineer

Remote

•

24d ago

Willing to go IN person interview nearby (Final round)Must have 14+ years of experience as Data Engineer and lead at least 2-3 projects.(Mandatory)Must have strong expertise in skills Kafka, AWS, Spark, Python,SQL (Must)Strong background in math, statistics, computer science, or data scienceProficiency in Snowflake, PythonHands-on experience with HDFS, YARN, Hive, Spark, Kafka, AWS, Docker/Kubernetes, Snowflake(Must)Proficiency in SAS, SQL, R, PythonFamiliarity with PostgreSQL, Redshift, Greenpl

Easy Apply

Contract

Depends on Experience

AWS Data Engineer with DataBricks & DBT Exp :: Remote :: W2 Only

Remote

•

6d ago

Job Title: Data Engineer Location: Remote Qualifications & Requirements:Bachelor's degree in Computer Science or a related technical field, or equivalent work experience.10+ years of experience in engineering environments, with a proven ability to translate abstract concepts into detailed software engineering plans.7+ years of experience leading data engineering initiatives, with a strong focus on delivering scalable and efficient data solutions.7+ years of technical leadership and architectura

Easy Apply

Contract

Depends on Experience

AI Data Platform Engineer/Architect

Remote

•

16d ago

Skills and Qualifications Experience in data engineering, ML platforms, or backend systems. Strong experience with Python, SQL, and modern data frameworks (e.g., Apache Spark, Airflow, dbt, Kafka). Familiarity with LLM-based agent frameworks (e.g., LangChain, LlamaIndex, AutoGen, CrewAI). Experience with vector databases (e.g., Pinecone, Weaviate, FAISS) and semantic search. Experience building event-driven architectures (Kafka, Pub/Sub, or similar). Understanding of LLM orchestration, prompt en

Easy Apply

Contract

$90 - $100

Sr.DataEngineerWith strongGoogle Cloud PlatformBackground (12+ yrs minimum experience required)

Philadelphia, Pennsylvania

•

Today

Title: Sr. Data Engineer With strong Google Cloud Platform Background Experience: 12+ Years Location: Onsite- From Philadelphia PA (Need only Locals to PA) Candidate has to be from PA Primary Skills- PySpark, Spark, Python, Big Data, Google Cloud Platform, Apache Beam, Dataflow, Airflow, Kafka and BigQuery Good to Have: GFO, Google Analytics Javascript is Must Job Description: 12+ years experience as a data warehouse engineer/architect designing and deploying data systems in a sta

Easy Apply

Contract, Third Party

$DOE

Azure Data Engineer

Remote

•

2d ago

Senior Data Engineer Location: San Diego, CA (preferred) or Remote, USA Full-Time | Direct Hire with Client About the RoleWe are seeking a Senior Data Engineer to design, build, and optimize data pipelines that power analytics and business intelligence initiatives across the organization. This role requires deep expertise in Azure Databricks and Azure Data Factory, with proven experience in developing scalable, reliable big data solutions in cloud environments. You will be a key contributor in t

Easy Apply

Full-time

Up to $140,000

Senior Software Engineer

Remote

•

17d ago

Hello, Greeting from Tavant. Please find the job description below and let me know if you are interested to submit. Basic Qualifications Bachelors degree in Computer Science, Electronics Engineering, or related field5+ years of professional programming in Java, Scala, Python, etc.3+ years of big data development experience with technical stacks such as Spark, Hive, Single Store, Airflow, and AWSStrong knowledge of system / application design and architectureExperience building industry level hi

Easy Apply

Full-time

Depends on Experience

Java Lead (Only 12+)

Remote

•

11d ago

We are seeking a highly skilled and motivated Technical Team Lead with a strong background in Java development and a passion for leading teams to deliver high quality software solutions. The ideal candidate will have extensive experience in Java 8, Spring, and Spring Boot, along with a solid understanding of CI/CD principles and tools such as Jenkins, Gradle, and Maven. This role requires a blend of technical expertise and leadership capabilities to guide a team of developers in achieving projec

Easy Apply

Full-time

Depends on Experience

AI ML Engineer

Remote or Hybrid in Dallas, Texas

•

Today

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We have an AI ML Engineer/Architect position available for 6 months and REMOTE. The pay rate is $75/hour W2. If you are interested, please send resume today. NO STEM OPT Job Summary: We are seeking a highly skilled and motivated Machine Learning / AI Engineer to join our team. You will be responsible

Easy Apply

Contract

BASED ON EXPERIENCE

Azure Data Engineer with Big Data

Remote

•

2d ago

Title: Azure Data Engineer with Big Data Location: Remote Duration: 6+ Months Contract Job Description: Senior Azure Data Engineer Investment BankingDesign and implement scalable data solutions using ADLS, Azure Synapse Analytics, and Azure Databricks to support high-volume financial data processing and analyticsExcellent hands on / programming skills on big data analytics azure cloud & on-prem technologies - spark, python, azure synapse, data factory , azure data bricks.The Senior Data Engineer

Easy Apply

Contract

Depends on Experience

Senior ML Platform Engineer

Remote or San Jose, California

•

6d ago

Senior ML Platform EngineerWe re looking for a seasoned engineer to help build and scale our ML data infrastructure platform. In this role, you ll design and develop the systems that power efficient data preparation, feature engineering, and dataset management laying the foundation for advanced machine learning capabilities.What You ll DoDesign and implement scalable data processing pipelines for ML training and validation.Build and maintain feature stores for batch and real-time features.Develo

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote

•

23d ago

Who we are! At 4Ci our mission is to build long term relationships, based on trust, integrity, and knowledge with all our employees and business affiliates. 4Ci has been in business for 20 years and has employees working on mission critical projects nationwide. We provide computer programming, testing, and system design services to develop and maintain multi-year, multi-million-dollar mission critical applications for the US Government. Examples of such applications are Medicaid MMIS systems, He

Easy Apply

Full-time

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Employer type

Work authorization

Apache Spark jobs in Pennsylvania, USA