Texas State Library and Archives Commision

Apply Now

Data Engineer

New York, NY, US • Posted 7 hours ago • Updated 7 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

Workflow
Analytics
Business Intelligence
Microsoft Power BI
Management
Meta-data Management
Documentation
Computer Science
Database
Data Modeling
Snow Flake Schema
Data Engineering
Data Lake
Databricks
Unity
GitHub
Microsoft Azure
Python
SQL
R
Scala
Project Management
ELT
Stacks Blockchain
Storage
Data Governance
Continuous Integration
Continuous Delivery
Analytical Skill
Problem Solving
Conflict Resolution
Teamwork
Communication
Microsoft Office
Collaboration

Workflow
Analytics
Business Intelligence
Microsoft Power BI
Management
Meta-data Management
Documentation
Computer Science
Database
Data Modeling
Snow Flake Schema
Data Engineering
Data Lake
Databricks
Unity
GitHub
Microsoft Azure
Python
SQL
R
Scala
Project Management
ELT
Stacks Blockchain
Storage
Data Governance
Continuous Integration
Continuous Delivery
Analytical Skill
Problem Solving
Conflict Resolution
Teamwork
Communication
Microsoft Office
Collaboration

Summary

Responsibilities:

Build and maintain data pipelines using Python and SQL.
Create and manage workflows in Databricks and migrate existing Azure Data Factory pipelines.
Load structured and semi-structured data into the Data Lakehouse (Delta Lake).
Write reusable and well-documented data transformations in Databricks.
Monitor pipeline performance and fix issues to meet service goals.
Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets.
Optimize Databricks views so BI tools like PowerBI run efficiently.
Help manage metadata and maintain documentation.

Take part in discussions about data platform architecture and improvements.
Qualifications:

Bachelor's degree in computer science, Engineering, IT, or related field, plus 5+ years' experience (or
equivalent).
Strong knowledge of databases, data modeling (star/snowflake), and data engineering best practices.
Hands-on experience with Azure Data Lake Storage, Databricks, Unity Catalogs, GitHub, and Azure tools.
Skilled in Python, SQL, R, or Scala.
Good project management skills; able to prioritize tasks and deliver improvements on time.
Experienced in building ELT pipelines and working with modern data stacks.
Understanding of Data Lakehouse, Delta Lake, and columnar storage.
Experience with data governance, dbt, or CI/CD environments is a plus.
Industry knowledge in construction is a bonus.
Strong analytical, problem-solving, and teamwork skills.
Clear communication, able to explain technical concepts to non-technical audiences.
Focused on improving processes and learning new technologies.
Proficient in Microsoft Office and collaboration tools.
Limited travel required.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 80183517
Position Id: 621fb067cb6e0f2245676ff34d7741da
Posted 7 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Jersey City, New Jersey

•

Today

Be Part Of A High-Performing Team: Join the technology organization of a global financial institution known for disciplined risk management, long-term client relationships, and continued investment in modern data capabilities. This role supports a compliance technology group responsible for delivering trusted, scalable data solutions in a highly regulated environment. The team is building modern ingestion, transformation, and storage capabilities that improve access to reliable metrics and supp

Easy Apply

Full-time

Senior Data Engineer

New York, New York

•

Today

The Senior Data Engineer is responsible for designing, building, and optimizing enterprise-scale data pipelines and analytics platforms across the Microsoft data ecosystem. This role leads the development of robust, scalable data solutions using Azure Data Factory, Databricks, Microsoft Fabric, SQL Server, and Python to support advanced analytics, machine learning, and business intelligence workloads. The engineer partners closely with architects, data scientists, and business stakeholders to mo

Full-time

USD 175,000.00 - 200,000.00 per year

Databricks Data Engineer

New York, New York

•

6d ago

Databricks Data EngineerWe are seeking an experienced Databricks Data Engineer to design, develop, and optimize scalable data solutions using the Databricks platform. The ideal candidate will build and maintain enterprise data pipelines, support analytics and reporting solutions, and work closely with business teams to deliver reliable data-driven solutions. Responsibilities:Develop and maintain Databricks-based data pipelines using Delta Lake, Delta Live Tables, and Workflows.Design and optimiz

Easy Apply

Contract

60 - 75

DataBricks Data Engineer

New York, New York

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a DataBricks Data Engineer for a CONTRACT assignment with one of our premier Insurance Services clients in New York, NY. We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, performance reporting, analytics,

Contract

USD 70.00 - 75.00 per hour

Search all similar jobs

More jobs at Texas State Library and Archives Commision in New York, NY

Data Engineer

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs