big data software engineer Jobs

Refine Results
21 - 40 of 16,792 Jobs

Big Data Engineer with Google Cloud Platform

Diamond Pick

Bentonville, Arkansas, USA

Full-time, Third Party

Hi, Hope you are doing well. Please find the below JD. Title: Big Data Engineer with Google Cloud Platform Location: Bentonville,AR Onsite Contract Note: Kindly share local profiles. Job Description: Assembling large to complex sets of data that meet non-functional and functional requirements Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes Building requir

Big Data Engineer

Newt Global

Tampa, Florida, USA

Contract, Third Party

Title:- Big Data Pyspark Engineer Location:- Tampa FL / Irving, TX Experience -4-6 Years Role Description: 1 Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns 2 Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework 3 Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like

Big Data Hadoop Engineer

INSPYR Solutions

Pleasanton, California, USA

Contract

Title: Big Data Hadoop Engineer Location: Pleasanton, CA Duration: 12 months+ Compensation: $52/hr - $74/hr Work Requirements: , Holders or Authorized to Work in the U.S. ABOUT THE ROLE: The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long-term IT strategy and planning to include high-level analysis, professional reports and presentations, and mentoring, support and training.CURR

Big Data Engineer (W2 Role)

Activesoft, Inc.

Remote

Contract

Big Data Engineer Remote (Need locals to Cincinnati, OH and Atlanta, GA) 6+ Months C2H Requirements: Proficient in Python programming with a proven track record of delivering high-quality code.Experience in data engineering, with a strong inclination towards Domain-Driven Design () principles.Familiarity with Apache NiFi, Kafka, Cassandra, Spark, and related technologies.Excellent communication skills, adept at collaborating effectively with cross-functional teams.Key Skills: Data Storage Solut

Data Scientist - Big Data Engineer (SAS Viya )

Talent Group

Austin, Texas, USA

Contract

Job Description: The client is seeking a dynamic and visionary Data Scientist to join our team and support our System Modernization efforts.This individual must be able to work in a heavily technical environment, preparing and optimizing data for Snowflake and utilizing SAS Viya to build comprehensive federal and state reports.Job Responsibilities: Data Conversion and Reporting Support for System Modernization Efforts.Data Transformation and Integration: Prepare and optimize data for migration t

Big Data Engineer

TechAffinity Inc

Texas, USA

Third Party, Contract

Title: Big Data Engineer Location: Texas REmote Duration: 3+ Months DESCRIPTION: Candidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity. Years Required/Preferred Experience 4 Required Proven experience in data conversion and report building using Snowflake and SAS Viya. 4 Required Demonstrated experience in data transformation processes using ETL, SQL, Python, and R. 4 Required Experie

Big Data Engineer

InfoGravity LLC.

Irving, Texas, USA

Contract, Third Party

skill set Must Have Big data expert with 6+ years experience in Hadoop Big data ecosystem Spark - Batch & Streaming (Python,Scala ) Apache Kafka hands on experience Experience in cloud environment, specially Google Cloud Platform Experience in developing both batch and real-time streaming data pipelines Python/Shell scripting Expertise in SQL Experience in Hive, Impala, Ozone, Iceberg Oozie and Airflow scheduler hands on experience Good to have Hadoop fundamental concepts CI/CD Cloudera ecosyste

Snowflake and SAS Viya (Data Scientist (Big Data Engineer) )

Cogent Data Solutions Llc

Remote

Contract

Hello, Cogent Data Solutions LLC trying to reach you regarding a job opportunity. The role is Snowflake and SAS Viya (Data Scientist (Big Data Engineer) ) for one of our direct clients. Please take a look at the job description below and please send your updated resume. Role: Snowflake and SAS Viya (Data Scientist (Big Data Engineer) )Location: RemoteClient Name: Office of the Attorney General of Texas Job Qualifications/ Skills:Minimum 4 years experience in Snowflake and SAS Viya Proven experi

Senior Data Engineer- Advanced SQL, Big Data-Day 1 Onsite in San Ramon, CA

CSI Consulting

San Ramon, California, USA

Contract

Day1 Onsite in San Ramon, CA Responsibilities for Data Engineer Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide va

Big Data/Java Engineer (Hybrid Role)

SOHO Square Solutions

San Francisco, California, USA

Contract, Third Party

Required Skills: The minimum experience is the absolute must haves and everything else is nice to have I would say it's heavy data modelling with some Python/Java/SQL/NO SQL scripting 2+ years of Java/Scala development experience. 2+ years of SQL and NoSQL experience (handling structured and unstructured data). 1+ years of extensive experience with Spark Processing engine. 1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka) 1+ years' e

Big Data Engineer // Locals only // Georgia

Empower Professionals

Alpharetta, Georgia, USA

Third Party, Contract

Role: Big Data Engineer Location: Alpharetta, GA (3 days a week onsite) Duration: 12+ Months Mandatory Skills: Big Data, Google Cloud Platform, Apache Spark, Apache Beam Requirements: Bachelor's degree in Computer Science, Systems Engineering or equivalent experience.5+ years of work experience as a Big Data Engineer.Data Engineering using Google Cloud Platform Technologies.3+ years of experience using Technologies such as Apache Spark, Hive, HDFS, Beam (Optional).3+ years of experience in SQL

BigData Engineer

Anblicks

Irving, Texas, USA

Full-time

Position: Big Data EngineerLocation : Irving, Texas - hybridDuration: long term Analyze and understand data sources & APIs Design and Develop methods to connect & collect data from different data sources Design and Develop methods to filter/cleanse the data Design and Develop SQL , Hive queries, APIs to extract data from the store Work closely with data Scientists to ensure the source data is aggregated and cleansed Work with product managers to understand the business objectives Work with

Big data engineer

Diamond Pick

Phoenix, Arizona, USA

Third Party, Contract

Role: Big Data Engineer Location: Phoenix, AZ (Onsite) Skills: Big Data, ETL Big Data / Data Warehousing, PySpark, Spark, Hive Qualifications: Bachelor s degree in Engineering or Computer Science or equivalent OR Master s in Computer Applications or equivalent.6+ years of software development experience and leading teams of engineers and scrum teams3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)Solid Data Warehousing concepts Knowledge of Financia

Big Data Engineer

ArnAmy, Inc.

Remote

Contract, Third Party

Job Purpose: The Office of the Attorney General s Chief Data Office (CDO) is seeking a dynamic and visionary Data Scientist to join our team and support our System Modernization efforts for the Child Support Division. This individual must be able to work in a heavily technical environment, preparing and optimizing data for Snowflake and utilizing SAS Viya to build comprehensive federal and state reports. You will play a pivotal role in transforming, analyzing, and leveraging our data assets to d

Big Data Engineer

ApTask

Tampa, Florida, USA

Full-time

Good to have- Certificate Databricks Certified Developer Apache Spark 3 0 Skills Databricks, Python or Java, PySpark, Spark, Spark SQL ETL Hadoop Databricks certification Responsibilities Ensure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure continual knowledge managementAdherence to the organizational guidelines and processesAs part of the delivery team your primary role would be to ensure effective Design Developm

Software Engineer/Consultant expert(Python/Java)- W2

Dechen Consulting Group

Dearborn, Michigan, USA

Contract

This is a W2 position, not C2C. THIRD PARTIES NEED NOT APPLY. This is a Software Engineer/Consultant expert position. Product Engineering and Management (PEM) is Global Data Insight and Analytics (GDIA) s primary capability to enable advanced analytics technologies in the Big Data space that will lead to improved quality, design, marketing, and development of our current and future products. This includes creating a production connected vehicle analytics platform to provide insights to Vehicle

Data Scientist - Big Data Engineer

HTC Global Services

Austin, Texas, USA

Full-time

HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies. At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life an

DevOps Engineer (Big Data Platform), Applied Machine Learning

Apple, Inc.

Sunnyvale, California, USA

Full-time

Summary Apple's Applied Machine Learning team has built platforms for a number of large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business, we manage many streams of Apple-scale data. We bring it all together and extract the value. We do all this with an exceptional group of so

Bigdata Hadoop Engineer

Softsol Resources Inc

Remote

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S

Senior Engineer - Big Data

Oracle Corporation

US

Full-time

Job Description We're looking for an experienced Data Engineer to join our growing team focused on building, supporting and enhancing the Oracle Hardware Division's (OHD) big data and analytics platform. This platform is at the heart of driving hardware quality, reliability, and efficiency as well as providing operational insights for impact and root cause analysis. We're strongly focused on supporting the high scale use cases of Oracle Cloud Infrastructure (OCI). We provide self service tools