Big Data Engineer

Overview

Remote
On Site
Full Time

Skills

Electronics
Consumer Electronics
Mobile Devices
Energy
Testing
Open Source
Algorithms
Programming Languages
Pandas
Apache Spark
FOCUS
Management
Customer Facing
Computer Hardware
Software Design
Project Scoping
User Experience
Workflow
Collaboration
Communication
Cloud Computing
Relational Databases
Query Optimization
Version Control
Release Management
Production Support
Job Scheduling
Data Quality
Reporting
Computer Engineering
Extract
Transform
Load
Writing
SQL
Python
Google Cloud
Google Cloud Platform
Kubernetes
Apache Airflow
Functional Requirements
Analytical Skill
Problem Solving
Conflict Resolution
Big Data
GitHub
Computer Science
Privacy

Job Details

Position Summary

Headquartered in Ridgefield Park, N.J., Samsung Electronics America, Inc. (SEA) is a leader in mobile technologies, consumer electronics, home appliances and enterprise solutions. The company pushes beyond the limits of today's technology to provide groundbreaking connected experiences across its large portfolio of products and services, including mobile devices, home appliances, home entertainment, 5G networks and digital displays. As an eleven-time winner of EPA's ENERGY STAR Partner of the Year Award for Sustained Excellence, SEA is dedicated to making a positive impact on the environment through its eco-conscious products, practices and operations.

People| Excellence | Change | Integrity | Co-prosperity

Role and Responsibilities

They have extensive experience with ETL design, coding, and testing as well as engineering software platforms and large-scale data infrastructures. Big Data Engineers should have the capability to develop highly scalable end-to-end pipeline using different open-source tools, including building and operationalizing high-performance algorithms. The engineer should understand how to apply technologies to solve big data problems on with knowledge in programming languages like Python, SQL and technologies like BigQuery, pandas, Kubernetes and Spark. Big data engineers implement complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable deliverables across customer-facing platforms. They have a strong aptitude to decide on the needed hardware and software design and can guide the development of such designs through both proof of concepts and complete implementations.
Additional qualifications should include:

Experience interacting with Data Analysts and Stakeholders to understand the project scope and requirements

Tune big data solutions to improve performance and end-user experience
Proficient in designing efficient and robust data workflows
Documenting requirements as well as resolve conflicts or ambiguities
Experience working in teams and collaborate with others to clarify requirements
Excellent oral and written communication skills.

Responsibilities and Duties:
  • Understand and document scope and requirements through interactions with analysts and stakeholders
  • Design and develop scalable code based custom ETL pipelines using big data technologies on Cloud platform.
  • Design and develop code to ingest data from a variety of data sources such as Relational databases, APIs and files.
  • Experience in developing Complex SQL transformations on BigQuery.
  • Code and query Optimization.
  • Follow and contribute to engineering best practices for source control using Github, release management, deployment etc.
  • Production support, job scheduling/monitoring, ETL data quality, data quality reporting

Background/Experience Required:

Bachelors or Masters in Computer Engineering.

2-3 years of experience on Big data Solutions on Google Cloud Platform. Expertise in Python, SQL( BigQuery preferred), Kubernetes and Airflow is a must have.

Necessary Skills and Attributes:
  • 2-3 years of code based ETL development using python and SQL
  • 2-3 years of experience writing complex SQL queries.
  • 2-3 years of Python development experience
  • 1+ years of experience on Google Cloud Platform services such as Bigquery, Kubernetes and Composer
  • Working experience in Apache Airflow
  • Experience in developing high-performance, reliable and maintainable code.
  • Experience in interacting with stakeholders and converting functional requirements into code design.
  • Analytical and problem-solving skills, applied to Big Data domain.
  • Experience and understanding of Big Data engineering concepts.
  • Proven understanding and hands on experience with GitHub, development IDEs such as VS code.
  • B.S. or M.S. in Computer Science or Engineering

Skills and Qualifications

#LI-JM1

Life @ Samsung - ;br>
Benefits @ Samsung - ;br>
* Please visit Samsung membership to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click here.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.