Big Data Engineer Jobs

Refine Results
1 - 20 of 165 Jobs

Big Data Engineer

Innosoul inc

Remote

Third Party, Contract

Job ID: TX-5176125DS3 Remote/Local Data Scientist/Big Data Engineer (15+) with ETL, DB2, SQL Server, Oracle, Erwin/data modeling, DW and Informatica experience Location: Austin, TX (TWC)Duration: 4 MonthsPosition: 1 Skills:8 Design and develop Extraction, Transformation, Load (ETL) processes for enterprise data warehouse using Informatica; Deep hands-on expertise with Informatica ETL processes, development, data management, data profiling, data flows, data relationships, and data quality standa

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer (Python/Spark/AWS) for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) We are seeking a Big Data Engineer to lead the design, develop, and maintain scalable data pipelines and infrastructure to support our market regulation technology applications. You will play a key role in modernizing existing data pipelines, enabling downstream use

Data Scientist (Big Data Engineer) 3

Rapisource LLC

Remote or Austin, Texas, USA

Contract, Third Party

Solicitation Number: 5176125DS3 Direct Client: Texas Workforce Commission Working Title: Data Scientist (Big Data Engineer) 3 Work Location: Austin, Tx - Telework JD: The Worker(s) will provide the following services: Perform complex Data Scientist work. Analyze information in TWC s Enterprise Data Warehouse and design, develop, and test processes for the data warehouse. Develop and document processes to extract data from the data warehouse for accurate reporting. Conduct complex data analysis a

W2-Hybrid :: Big Data Engineer / Developer

Bitsoft International, Inc.

Charlotte, North Carolina, USA

Full-time

Big Data Engineer / Developer 6+Months Charlotte, NC (Hybrid) **Core Requirements** - At least 6 years' proficiency in Big Data, Spark, Scala, and Cloud technologies - Proven expertise in utilizing Spark and Scala, as well as familiarity with leading cloud services providers, notably AWS, Azure, and Google Cloud Platform for Big Data operations - Advanced knowledge and operational skills with Azure Data Lake Storage (DLS) - Demonstrable proficiency in using Databricks for data integration and pi

Big Data Engineer - C13 - IRVING

Citi

Remote or Irving, Texas, USA

Full-time

The Big Data Engineer is a strategic professional who combines deep domain knowledge with modern data engineering and AI capabilities to drive high-impact solutions. The role demands strong commercial awareness, technical leadership, and the ability to influence key stakeholders. The ideal candidate will have a strong foundation in traditional ML techniques, Deep learning, and Generative AI, along with hands-on experience in big data platforms and data engineering stacks (Hadoop, PySpark, SnowFl

Sr Software Engineer (Big Data)

PaloAlto Networks

Santa Clara, California, USA

Full-time

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Big Data Engineer/Developer, AVP (C12)

Citi

Remote or Jersey City, New Jersey, USA

Full-time

About Citi: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemic

Data Scientist (Big Data Engineer)

TexcelVision Inc.

Austin, Texas, USA

Contract, Third Party

Respond by: 05/07/2025 Rate: DOE Type: Contract Perform complex Data Scientist work. Analyze information in Enterprise Data Warehouse and design, develop, and test processes for the data warehouse. Develop and document processes to extract data from the data warehouse for accurate reporting. Conduct complex data analysis and visualization tasks along with gathering, determining data quality/profiles, data cleansing, and preparing data from various sources. Perform other analysis and documentat

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu

Big Data Engineer

Nityo Infotech Corporation

Austin, Texas, USA

Full-time

Job Role: Big Data Engineer Job Location: Austin, TX Jon Type: Full Time Job Description: Client is seeking a Big Data Engineer. In this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables fo

Big Data Engineer

Judge Group, Inc.

Dallas, Texas, USA

Full-time

Location: Dallas, TX Description: Our client is currently seeking a Big Data Engineer Required Qualifications: 4+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education2+ years of technical leadership or architecture experience, in a data and technical environment2+ years of experience in Automation testing (Selenium/Karate/BDD)2+ years of experience in Performance testing

Lead Big Data Engineer

Avance Consulting

Austin, Texas, USA

Full-time

Basic Qualifications At least 4 years of Information Technology experience3 years of experience in BI and Spark, Scala.Proficient in writing complex SQLs, expertise in performance tuning of SQLs.Proven experience in designing end-to-end reporting and dashboarding applications.Experience in designing and developing ETL data pipelines.Basic working knowledge of Python scripting and programming.Minimum of 1 year hands on experience in Snowflake database and table designGood communication and interp

Big Data Engineer (F2F interview)

CoppelTech

Massachusetts, USA

Contract, Third Party

Big Data Engineer (Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda is a must) Location: Boston, MA (locals only) F2F interview. No h1 B Share DL, Visa and LinkedIn Responsibilities: Design and implement production big data environments using modern technologies. Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments. Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink). To be su

Big Data Engineer

ConsultNet, LLC

Rockville, Maryland, USA

Full-time

Title: Big Data Engineer Location : Rockville, Maryland (hybrid) Target Start Date : May 15, 2025 Type: contract Pay Rate: DOE We are looking for an experienced Big Data Engineer to lead the modernization and development of scalable data pipelines that support market regulation and surveillance applications. This role will focus on building efficient, cloud-native ETL systems, enabling data science experimentation, and ensuring high performance and governance in data workflows. Key Responsibili

Big Data Engineer

ConsultNet, LLC

Rockville, Maryland, USA

Full-time

Title: Big Data Engineer Location : Rockville, Maryland Target Start Date : May 15, 2025 Type: contract Pay Rate: DOE We are looking for a skilled Big Data Engineer to design, build, and optimize scalable data processing systems. This role involves working closely with cross-functional teams to develop data pipelines, implement integration solutions, and ensure high performance and reliability of big data platforms. Key Responsibilities: Design, build, and maintain large-scale data pipelines us

Sr Big Data Engineer

Anblicks

Irving, Texas, USA

Full-time

Must be local to TX Core Skills: Python, Pyspark, Distributed data processing & CI/CD skills- Gen AI exposure is plus Roles and responsibilities: Proficiency in Python, SQL, and AI/ML frameworks (Transformers, LangChain, OpenAI, Hugging Face, PyTorch, TensorFlow).Strong understanding of AI cost optimization strategies, including serverless inference, model distillation, quantization, and GPU efficiency tuning.Experience deploying AI models in cloud environments (AWS, Azure, Google Cloud Platform

Big Data Engineer (Neo4J)

Apidel Technologies

Philadelphia, Pennsylvania, USA

Contract

Location: Philadelphia, PA (Onsite preferred 4 days in office, Fridays remote) Job Overview: Looking for someone with expertise in Big Data engineering and Graph Databases (Neo4j) to support API development for better network understanding. The role involves ETL development using Databricks with a strong focus on PySpark and containerized infrastructure. The candidate will play a key role in a structural Big Data approach for Comcast s fiber footprint, specifically focusing on new Big Data ETL s

Long Term W2 Contract - JAVA ETL Big Data Engineer, NYC, NY / Phoenix, AZ

CovetIT

New York, New York, USA

Contract

Job: Java ETL Big Data Engineer Location: NYC, NY / Phoenix, AZ Type: Long term W2 Contract This is onsite Position Job Description: We are looking for a skilled Java ETL Big Data Engineer to design, build, and maintain scalable data pipelines and data warehousing solutions on Google Cloud Platform (Google Cloud Platform). The ideal candidate will have hands-on experience in Java-based ETL development, big data technologies, and cloud-based data engineering. Skills: Java, ETL - Big Data / Dat

Sr Big Data Engineer - Oozie and Pig (Google Cloud Platform)

Spiceorb

Remote

Full-time

Sr Big Data Engineer - Oozie and Pig (Google Cloud Platform) Public Cloud - Offerings and Delivery Cloud Data Services Work Location: US-Remote, Canada-Remote - Full Time About the Role We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requi

Principal Software Engineer - Big Data Processing - HDI

Oracle Corporation

No location provided

Full-time

Job Description The Oracle Health Data Intelligence Platform team builds and operates the healthcare data processing and intelligence system that keeps patient records and other relevant health data for all Oracle Health applications and services. Values are HDI's foundation and how we deliver excellence. We iterate and improve based on the data and customer feedback. We are constantly learning and taking opportunities to grow our careers and ourselves. We challenge each other to stretch beyon