Texas State Library and Archives Commision

Apply Now

Python Data Engineer

Hartford, CT, US • Posted 6 days ago • Updated 1 hour ago

Full Time

On-site

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

Decision-making
PySpark
Python
Data Lake
Microsoft Azure
Data Integration
Databricks
Data Processing
Data Wrangling
Advanced Analytics
Data Quality
Regulatory Compliance
Data Governance
Collaboration
Performance Tuning
Optimization
Workflow
Specification Gathering
Insurance
Documentation

Summary

Job Description:

We are looking for a skilled Python Data Engineer with hands-on experience in Azure, PySpark, and Databricks, specifically within the insurance domain. This is a hybrid, long-term contract position requiring a mix of remote and onsite work in either Hartford, CT or Charlotte, NC. The ideal candidate will be responsible for building, optimizing, and maintaining data pipelines and supporting data-driven decision-making across the organization.
Key Responsibilities:

Design and develop scalable and robust data pipelines using PySpark and Python.
Leverage Azure Data Services (e.g., Azure Data Factory, Azure Data Lake, Azure Synapse) for data integration and transformation.
Utilize Databricks for distributed data processing, data wrangling, and advanced analytics.
Ensure data quality, integrity, and compliance with data governance and security policies.
Collaborate with cross-functional teams, including business analysts, data scientists, and application developers.
Participate in performance tuning, troubleshooting, and optimization of data workflows.
Translate business requirements into technical specifications, especially within the insurance industry context.
Develop and maintain documentation for data pipelines and architecture.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 80183517
Position Id: ffecffe55722e33248592cee25101d17
Posted 6 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

DATA Engineer

Hybrid in East Hartford, Connecticut

•

5d ago

Must be Local only within 40 Miles area Relocation will not work Look insurance domain highly preferredJob Description: 11 Years exp We are looking for a Senior Data Engineer to design, build, and optimize scalable data pipelines and warehouse solutions that power business-critical analytics. You will work closely with data architects, analysts, and business stakeholders to deliver robust data products on modern lakehouse platforms.Key ResponsibilitiesDesign and develop end-to-end data pipelin

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote

•

Today

CTEC is a leading technology firm that provides modernization, digital transformation, and application development services to the U.S. Federal Government. Headquartered in McLean, VA, CTEC has over 300 team members working on mission-critical systems and projects for agencies such as the Department of Homeland Security, Internal Revenue Service, and the Office of Personnel Management. The work we do effects millions of U.S. citizens daily as they interact with the systems we build. Our best-in-

Full-time

Senior Databricks Developer

Remote

•

2d ago

Senior Databricks Developer (Full-Time) Location: Remote (USA) Responsibilities Design and develop scalable data engineering solutions using Databricks.Build ETL/ELT pipelines using Apache Spark and PySpark.Develop data ingestion and transformation processes from multiple data sources.Optimize Spark jobs for performance and scalability.Implement Delta Lake architecture and data quality best practices.Collaborate with data architects, analysts, and business stakeholders.Support CI/CD deployments

Easy Apply

Full-time, Third Party

Depends on Experience

Databricks SME (Remote)

No location provided

•

Today

Overview: GovCIO is hiring a Databricks SME to support the Department of Veterans Affairs (VA) Data Modernization initiative. In this role, the Databricks SME will guide data scientists, analysts, infrastructure specialists and business SME to deliver production-ready data solutions.This position focuses on workspace automation, onboarding support, data platform usability, infrastructure provisioning, and white?glove customer success to ensure VA users can rapidly adopt and leverage modern data

Full-time

Compensation information provided in the description

Search all similar jobs

More jobs at Texas State Library and Archives Commision in Hartford, CT