Big data Jobs

Refine Results
1 - 20 of 1,778 Jobs

Big data Tester

Ztek Consulting

Pittsburgh, Pennsylvania, USA

Contract, Third Party

Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complex SQL scripting to validate source/target data load and transformationExperience in Bigdata data pipeline testing with Hadoop/Spark framework in AWS cloud infrastructureKnowledge of applying the Spark DataFrame API concepts using PySpark to complete data manipulation task sVery good understanding of business intelligence concepts, architecture & building blocks in areas ETL processing, Da

Big Data Developer

Info Way Solutions

Austin, Texas, USA

Contract

Role: Big Data DeveloperLocation: Austin, TX Title Sr. Big Data Developer Updated JD: 10+ years of hands-on and strong experience in python programming 10+ years of experience in developing test automation utilities for data reconciliation validation using python data science libraries Hands-on experience in pandas, numpy, pyspark, big data technology 8+ years of experience in handling resources like AWS glue, ec2 and lambda Proficient in writing complex sql queries 10+ years of experience in h

Big Data Engineer with Google Cloud Platform

Donato Technologies Inc

Temple Terrace, Florida, USA

Contract

Job Title: Google Cloud Platform Big Data Engineer Location: Temple Terrace, FL (Hybrid) Duration: Up to 30 Months i.e., 2.5 Years (Including extensions) JOB DESCRIPTION :- Must have Good Hands-On on Big Data Development. Artificial Intelligence and Data team is looking for BI engineers with expert level experience in developing enterprise software applications on Google Cloud Data Flow Engineer (3-4 Years Experience) Position Summary: Seeking a skilled Google Cloud Data Flow Engineer with a pro

Google Cloud Platform Big Data Engineer

Triwave Solutions Inc

Temple Terrace, Florida, USA

Contract

NOTE: This position is not Remote (Candidate Open to Hybrid or Relocation to Temple Terrace FL 3 Days/week) MUST HAVE: Google Cloud Platform and Big Data Development experience. Please do not apply if you are not interested in hybrid and does not have Must Have skills. Job Title: Google Cloud Platform Big Data Engineer Duration: Up to 30 Months i.e., 2.5 Years (Including extensions) Client: One of top in fortune 50 companies. JOB DESCRIPTION :- Must have Good Hands-On on Big Data Developmen

Big Data Architect

Tigerworld

Corvallis, Oregon, USA

Third Party, Contract

Data Architect Location: Corvallis, OR Onsite Role Long Term Project Job Description: The data engineering role is a team member that will help enhance and maintain the CSS Business Analytics and Instant Ink Business Intelligence system. You will drive work you're doing to completion with hands-on development responsibilities, and partner with the Data Engineering leaders to implement data engineering pipelines to build solution to help provide trusted and reliable data to customers. Responsibil

Big Data and Cloud Analytics Consultant

Randstad Digital

Atlanta, Georgia, USA

Full-time

job summary: Our Client is seeking a skilled AWS Data Engineering Architect to design, implement, and manage data solutions on AWS. Responsibilities include architecting scalable data pipelines, collaborating with cross-functional teams, and implementing best practices for data governance and optimization. The ideal candidate will have a Bachelor's or Master's degree in Computer Science, Engineering, or related field, with proven experience in data engineering on AWS. Key skills include profici

Big Data Hadoop Engineer

INSPYR Solutions

Pleasanton, California, USA

Contract

Title: Big Data Hadoop Engineer Location: Pleasanton, CA Duration: 12 months+ Compensation: $52/hr - $74/hr Work Requirements: , Holders or Authorized to Work in the U.S. ABOUT THE ROLE: The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long-term IT strategy and planning to include high-level analysis, professional reports and presentations, and mentoring, support and training.CURR

Big Data Engineer with Google Cloud Platform || Location : Phoenix, AZ Day 1 onsite

eRay Technologies LLC

Phoenix, Arizona, USA

Full-time

Degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field (or equivalent work experience)3+ years of experience working as a big data engineer (Required) must be able to articulate use cases supported and outcomes driven.Strong in a any cloud like AWS / Google Cloud Platform.Expertise in Java language.knowledge of the following (expectation is to demonstrate these skills live during the interview): PySpark, Spark, Python, Scala, Hive, Pig, and MapReduceE

Spark/Big Data Developer

HireTeq

McLean, Virginia, USA

Full-time

Role: Spark/Big Data Developer Location: McLean, VA,Dallas,TX (hybrid) Job Type: Fulltime Mandatory exp: Spark Data Engineer,with Batch, Python, Sql or No Sql, distributed data processing, Data pipleline,cloud (AWS or Azure). Should be keen to learn/work Blockchain Job description:The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform.Data engineers will implement infrastructure for data processing, analysis, reporti

Big Data Engineer

iMinds Technology Systems, Inc.

Jacksonville, Florida, USA

Contract

Position: Big Data Engineer Location: Jacksonville, FL Duration: 12+Months Contract Job Description: Scala Role: Must: Scala 2 and above AKKA 2.12 and above Elastic Search 7.17 and above SQL Linux/Unix Having exposure to handling high-volume data Test Driven Development / Agile Nice to have: Global Markets / Reconciliations knowledge exposure in migrations, building APIs exposure to React / Angular (UI framework) Need to be working out of JAX location (min 3 days/week office Govardhan Nemalipuri

Senior Software Engineer - Big Data, Data Processing, hyperscale experience required

Oracle Corporation

US

Full-time

Job Description At Oracle our exciting mission to build a premier health data platform with intelligent services, brings about several interesting technical challenges. As part of this team, you will accelerate several architectural efforts - achieve orders of magnitude data processing latency improvement, creating comprehensive patient health records that can scale to entire populations of nations, creating a health data lake at massive scale to enable a host of intelligent health services. He

Software Development Director-Big Data

Oracle Corporation

US

Full-time

Job Description We're looking for a Software Development Director who can lead engineering teams through the architectural changes to deliver a hyperscale, cloud-based data processing system that can handle massive amounts of data with low latency. In this role you will have responsibility for the architecture of the health data platform and provide leadership to software development teams to complete the vision. Qualifications Experience building cutting edge, highly scalable data processing

BigData with Spark - ONLY LOCAL to TX

Innovative Information Technologies, Inc

Austin, Texas, USA

Contract

Bigdata with Spark Austin, TX Long Term Job Description : One of our client is looking for strong Bigdata Developer with Spark experience.

Big Data

OJUS LLC

Jersey City, New Jersey, USA

Contract

Big Data Developer Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must have experience working in different SDLC phases

Bigdata Developer - Bigdata/Spark Developer (No C2C)

HireTeq

McLean, Virginia, USA

Full-time

Spark/Big Data Developer Hybrid Role 3 Days Onsite & 2 Days Remote Fulltime Permanent JOB DESCRIPTION: The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform.Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment. RESPONSIBILITIES: Technical expertise with distributed Spark or other distributed data processing technologiesWork with la

Azure Big Data Lead

Quadratic Systems, Inc.

Philadelphia, Pennsylvania, USA

Contract

Role: Azure Big Data Lead Location: Philadelphia, PA (Hybrid work) Type: Full Time and 12+ Contract Job Description Primary Skill : 1 Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in DataBricks 2 ADF Secondary Skills 1 Azure data lake gen 2 2. Synapse analytics (dedicated SQL pool) 3. Exp in delta Lake 4. Pyspark Nice to Have : Tidal Scheduler , Exp in Healthcare Domai

Big Data Engineer

Motion Recruitment Partners, LLC

New York, New York, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Big Data Engineer in New York, NY. (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also tr

Bigdata Lead

Tanisha Systems, Inc.

Woodbridge Township, New Jersey, USA

Contract

Position : Big Data Lead / Data Engineer Location : Philadelphia, PA (Remote) EST Prefer Duration : Contract JOB DESCRIPTION : Primary Skill : 1 Azure data bricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in Data Bricks 2 ADF Secondary Skills 1 Azure data lake gen 2 2. Synapse analytics (dedicated SQL pool) 3. Exp in delta Lake 4. Pyspark Nice to Have : Tidal Scheduler , Exp

Big Data Engineer

ApTask

Irving, Texas, USA

Full-time

Qualifications 7-9 years of relevant experienceStrong Core Java Python Scala working experienceStrong Experience in Big data technologies like Apache Spark HDFS Hive HbaseComfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniquesExperienced with Linux Unix platformExperience in RDMS and No SQL databasesExperience in Service oriented architecture SOA and data standards like JSON Avro ParquetExperience using ALM an

Big Data Engineer

ApTask

Tampa, Florida, USA

Full-time

Good to have- Certificate Databricks Certified Developer Apache Spark 3 0 Skills Databricks, Python or Java, PySpark, Spark, Spark SQL ETL Hadoop Databricks certification Responsibilities Ensure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure continual knowledge managementAdherence to the organizational guidelines and processesAs part of the delivery team your primary role would be to ensure effective Design Developm