Data Engineer - Pyspark ( Fulltime )

Dallas, TX, US • Posted 16 hours ago • Updated 16 hours ago

Full Time

No Travel Required

On-site

Depends on Experience

Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

PySpark
Python
Apache Spark
SQL
R
Cloud Computing
Database
Databricks
Microsoft Azure
Amazon Web Services
Extract, Transform, Load
Workflow
Cloud Storage
Cloud Architecture

Summary

Data Engineer are primarily responsible for developing, optimizing, and maintaining large-scale data pipelines, ETL workflows, and data transformations within cloud environments (AWS, Azure, Google Cloud Platform) and Databricks. Roles typically require 3 - 10 years of experience in Python, PySpark, Spark SQL, and cloud storage.

Job description:

Python, Pyspark,Databricks, AWS cloud architecture,
- Previous experience as a data engineer or in a similar role
- Must have experience with AWS Python, Pyspark,AWS, Databricks, Lambda function services such as SQL Database, Python.
- Knowledge of programming languages and environments such as Python, Java, Scala, R
- Hands-on experience with SQL.
- Great numerical and analytical skills
- Degree in Computer Science, IT, or similar field; a Masters is a plus
Understanding of ETL

Thanks,

Aravindharaj

Newt Global LLC

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10119089
Position Id: 8898925
Posted 16 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.