Texas State Library and Archives Commision

Apply Now

Python PySpark/ Data Engineer

Plano, TX, US • Posted 4 hours ago • Updated 4 hours ago

Full Time

On-site

USD 60.00 per hour

Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

PySpark
Migration
Amazon Web Services
Databricks
Cloud Computing
Database
SQL
Object-Oriented Programming
Python
Real-time
Streaming
Apache Spark

Summary

Job Description:

6+ years of professional work experience designing and implementing data pipelines in a cloud environment is required.
5+ years of experience migrating/developing data solutions in the AWS cloud is required.
2+ years of experience building/implementing data pipelines using Databricks or similar cloud database.
Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
Hands-on object-oriented programming experience using Python is required.
Professional work experience building real-time data streams using Spark and Experience in Spark.
Knowledge or experience in architectural best practices in building data lakes

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 80183517
Position Id: 91e466f5e8697dcb39891ad8eb127f9e
Posted 4 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Databricks Data Engineer

Dallas, Texas

•

Today

Responsibilities: Partner with business stakeholders and Global Product teams to understand data domains, business processes, and analytical requirements.Design, develop, and maintain scalable data pipelines and transformation jobs on the Databricks Lakehouse Platform to generate business metrics, KPIs, and curated datasets.Develop and optimize batch and streaming data pipelines using Databricks, Apache Spark (PySpark/Scala), and Delta Lake technologies.Build and maintain data ingestion framewor

Easy Apply

Contract

Depends on Experience

Lead Data engineer

Dallas, Texas

•

Today

Job Title: Sr Technical Lead Location: Dallas, TX Mode: Hybrid(3 day a week onsite) C2C or W2 Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must. Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark . Realtime experience on databricks is must. Evaluates and plans software designs, test resu

Easy Apply

Full-time, Part-time, Contract, Third Party

Technical Lead Data Engineer

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - DataLocation: Dallas, TX(Locals Preferred but ok in US)Mode: Hybrid(3 day a week onsite)Note: Client Interview is must.Mandatory skills: AWS, Databricks, Python, Spark & PysparkKey Responsibilities:Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software de

Easy Apply

Third Party, Contract

Hybrid: Sr. Data Technical Lead

Hybrid in Dallas, Texas

•

Today

Job Title: Sr Technical Lead - Data Note: Client Interview is must. Mandatory skills: AWS, Databricks, Python, Spark & Pyspark Key Responsibilities: Experience: 6 to 10 years Realtime experience on databricks is must.Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .Realtime experience on databricks is must.Evaluates and plans software designs, test results and technical manuals using AWS.Confer with business units a

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs

More jobs at Texas State Library and Archives Commision in Plano, TX