big data engineer Jobs

Refine Results
1 - 20 of 156 Jobs

Big Data Engineer

Randstad Digital

Pennsylvania, USA

Contract

job summary: Responsibilities Monitors data usage requests received by Personal Investor to ensure timely responses. location: Malvern, Pennsylvania job type: Contract salary: $47 - 52 per hour work hours: 8am to 5pm education: Bachelors responsibilities: Triages to determine if requests are in good order, returning those that need more information and assigning those that are ready to work. Over time will train to disposition basic, lower-risk requests. qualifications: Qualifications Fam

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer (Python/Spark/AWS) for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) We are seeking a Big Data Engineer to lead the design, develop, and maintain scalable data pipelines and infrastructure to support our market regulation technology applications. You will play a key role in modernizing existing data pipelines, enabling downstream use

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu

Big Data Engineer

Judge Group, Inc.

Dallas, Texas, USA

Full-time

Location: Dallas, TX Description: Our client is currently seeking a Big Data Engineer Required Qualifications: 4+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education2+ years of technical leadership or architecture experience, in a data and technical environment2+ years of experience in Automation testing (Selenium/Karate/BDD)2+ years of experience in Performance testing

Big Data Engineer - C13 - IRVING

Citi

Remote or Irving, Texas, USA

Full-time

The Big Data Engineer is a strategic professional who combines deep domain knowledge with modern data engineering and AI capabilities to drive high-impact solutions. The role demands strong commercial awareness, technical leadership, and the ability to influence key stakeholders. The ideal candidate will have a strong foundation in traditional ML techniques, Deep learning, and Generative AI, along with hands-on experience in big data platforms and data engineering stacks (Hadoop, PySpark, SnowFl

W2-Hybrid :: Big Data Engineer / Developer

Bitsoft International, Inc.

Charlotte, North Carolina, USA

Full-time

Big Data Engineer / Developer 6+Months Charlotte, NC (Hybrid) **Core Requirements** - At least 6 years' proficiency in Big Data, Spark, Scala, and Cloud technologies - Proven expertise in utilizing Spark and Scala, as well as familiarity with leading cloud services providers, notably AWS, Azure, and Google Cloud Platform for Big Data operations - Advanced knowledge and operational skills with Azure Data Lake Storage (DLS) - Demonstrable proficiency in using Databricks for data integration and pi

Big Data Engineer

Nityo Infotech Corporation

Austin, Texas, USA

Full-time

Job Role: Big Data Engineer Job Location: Austin, TX Jon Type: Full Time Job Description: Client is seeking a Big Data Engineer. In this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables fo

Sr Software Engineer (Big Data)

PaloAlto Networks

Santa Clara, California, USA

Full-time

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Lead Big Data Engineer

Avance Consulting

Austin, Texas, USA

Full-time

Basic Qualifications At least 4 years of Information Technology experience3 years of experience in BI and Spark, Scala.Proficient in writing complex SQLs, expertise in performance tuning of SQLs.Proven experience in designing end-to-end reporting and dashboarding applications.Experience in designing and developing ETL data pipelines.Basic working knowledge of Python scripting and programming.Minimum of 1 year hands on experience in Snowflake database and table designGood communication and interp

Big Data Engineer

ConsultNet, LLC

Rockville, Maryland, USA

Full-time

Title: Big Data Engineer Location : Rockville, Maryland (hybrid) Target Start Date : May 15, 2025 Type: contract Pay Rate: DOE We are looking for an experienced Big Data Engineer to lead the modernization and development of scalable data pipelines that support market regulation and surveillance applications. This role will focus on building efficient, cloud-native ETL systems, enabling data science experimentation, and ensuring high performance and governance in data workflows. Key Responsibili

Big Data Engineer (F2F interview)

CoppelTech

Massachusetts, USA

Contract, Third Party

Big Data Engineer (Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda is a must) Location: Boston, MA (locals only) F2F interview. No h1 B Share DL, Visa and LinkedIn Responsibilities: Design and implement production big data environments using modern technologies. Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments. Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink). To be su

Big Data Engineer

ConsultNet, LLC

Rockville, Maryland, USA

Full-time

Title: Big Data Engineer Location : Rockville, Maryland Target Start Date : May 15, 2025 Type: contract Pay Rate: DOE We are looking for a skilled Big Data Engineer to design, build, and optimize scalable data processing systems. This role involves working closely with cross-functional teams to develop data pipelines, implement integration solutions, and ensure high performance and reliability of big data platforms. Key Responsibilities: Design, build, and maintain large-scale data pipelines us

Senior Big Data Engineer - Location preference NC

Techmatic Inc

Charlotte, North Carolina, USA

Third Party, Contract

Senior Big Data Engineer - Prefer Locals to Charlotte Required Skills Scala PySpark Spark Google Cloud Platform (DataProc/Composer/BQ) Airflow Grafana 10+ years of Data Engineering 8+ years of PySpark/Scala 7 years of Scala 5+ years of experience hosting application on Google Cloud Platform

Sr Big Data Engineer

Anblicks

Irving, Texas, USA

Full-time

Must be local to TX Core Skills: Python, Pyspark, Distributed data processing & CI/CD skills- Gen AI exposure is plus Roles and responsibilities: Proficiency in Python, SQL, and AI/ML frameworks (Transformers, LangChain, OpenAI, Hugging Face, PyTorch, TensorFlow).Strong understanding of AI cost optimization strategies, including serverless inference, model distillation, quantization, and GPU efficiency tuning.Experience deploying AI models in cloud environments (AWS, Azure, Google Cloud Platform

Big Data Engineer (Neo4J)

Apidel Technologies

Philadelphia, Pennsylvania, USA

Contract

Location: Philadelphia, PA (Onsite preferred 4 days in office, Fridays remote) Job Overview: Looking for someone with expertise in Big Data engineering and Graph Databases (Neo4j) to support API development for better network understanding. The role involves ETL development using Databricks with a strong focus on PySpark and containerized infrastructure. The candidate will play a key role in a structural Big Data approach for Comcast s fiber footprint, specifically focusing on new Big Data ETL s

Sr Big Data Engineer - Oozie and Pig (Google Cloud Platform)

Spiceorb

Remote

Full-time

Sr Big Data Engineer - Oozie and Pig (Google Cloud Platform) Public Cloud - Offerings and Delivery Cloud Data Services Work Location: US-Remote, Canada-Remote - Full Time About the Role We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requi

SQL Server / Big Data - Software Engineer 3

Genesis10

Texas, USA

Full-time

Genesis10 is currently seeking a SQL Server / Big Data Engineer with our client in the financial Industry located in Irving, TX. This is a 24+ month contract position. Responsibilities: Develop and optimize complex SQL Server queries based on business requirements Support and enhance an existing data framework using SQL Server Apply knowledge of the Hadoop ecosystem to inform decisions around data structure, architecture, and scalability (hands-on experience not required, but must understand the

Principal Software Engineer - Big Data Processing - HDI

Oracle Corporation

No location provided

Full-time

Job Description The Oracle Health Data Intelligence Platform team builds and operates the healthcare data processing and intelligence system that keeps patient records and other relevant health data for all Oracle Health applications and services. Values are HDI's foundation and how we deliver excellence. We iterate and improve based on the data and customer feedback. We are constantly learning and taking opportunities to grow our careers and ourselves. We challenge each other to stretch beyon

Big Data Engineer (Kafka Stream / Java)

MDMS Recruiting

Chicago, Illinois, USA

Full-time

Big Data Developer: Location: Chicago, IL (hybrid), local Candidates only Full time Core Skills: Java, Spark, Kafka, and Cloud As a Sr. Big Data Java Engineer, you will work in the development of our data lake streaming platform in Azure. As member of the Feature Team, you will work in autonomy, which includes the following development tasks: Architect, design and develop Kafka Stream based Java applications in AzureArchitect, design and develop data pipelines for Big Data volume using Spark (

Big Data Engineer W2 CONTRACT ROLE

Zentek Infosoft Inc

New York, New York, USA

Contract

Hi,Greetings from Zentek Infosoft Inc. !!We have an immediate opening with one of our clients, please go through the job description and if you are interested kindly share your updated resume ASAP. A little bit about Zentek Infosoft: Zentek Infosoft Inc. have been providing Information Technology solutions, enterprise staffing and professional services for organizations in every industry, in the public and private sectors, and of every size, from start-ups to Fortune 500 firms over the last 6 ye