Azure Data Engineer

Hybrid in Norwalk, CT, US • Posted 4 hours ago • Updated 4 hours ago

Full Time

No Travel Required

Hybrid

105000 - 115000/yr

Top Prospect Group

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

azure
databricks
python
sql
pandas
rlt
pipeline development
data modeling
data transformation
data factory
data visualizations
CI/CD
data engineerinh

Summary

Overview:

We are seeking a Data Engineer to design, build, and maintain scalable data solutions that support analytics, data science, and business intelligence initiatives. This role will focus on developing modern data pipelines, optimizing data architecture, and collaborating with cross-functional teams to deliver high-quality, reliable data.

Key Responsibilities

Design, develop, and maintain scalable data pipelines and ETL/ELT processes leveraging cloud-native technologies
Build robust, high-performance solutions using Python with a focus on scalability and reliability
Automate and schedule workflows to improve efficiency and data accuracy
Support and enhance cloud-based infrastructure, applying DevOps best practices to ensure availability and scalability
Partner with data scientists, analysts, and business teams to understand data requirements and deliver effective solutions
Maintain high code quality through CI/CD pipelines, version control, automated testing, and peer reviews
Monitor emerging technologies and recommend improvements to data engineering and cloud practices
Optimize and manage relational databases to support analytical workloads
Implement data quality, governance, and monitoring frameworks to ensure integrity and compliance
Design and develop dimensional data models, including star schemas and semantic layers for reporting and analytics
Build and maintain transformation logic using SQL and Python
Develop and automate KPIs and metrics from multiple data sources
Conduct exploratory data analysis to support business insights and reporting needs
Collaborate with data science teams to deploy and operationalize machine learning models

Qualifications

Required:

2+ years of experience in data engineering with a focus on data modeling, pipeline development, and ETL/ELT processes
Advanced SQL skills, including complex query development, optimization, and performance tuning
Hands-on experience with Python for data engineering (Pandas, NumPy, PySpark, etc.)
Experience working with cloud platforms (Azure preferred; AWS or Google Cloud Platform also acceptable)
Familiarity with data orchestration tools such as Azure Data Factory, Airflow, Prefect, or Dagster

Preferred:

Experience with data visualization tools (e.g., Plotly, Matplotlib)
Exposure to analytics platforms and business intelligence solutions
Understanding of DevOps practices and CI/CD pipelines in a data environment

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10415428
Position Id: 8931225
Posted 4 hours ago

Company Info

About Top Prospect Group

Top Prospect Group was founded by a select group of IT staffing professionals who believe in what they do and continuously strive for excellence. At TPG, we don’t subscribe to the just get the deal done philosophy common in most agencies, instead opting for a more personable approach. It’s what makes us different: we care! Motivated by a partnership philosophy, our staff possesses a deep understanding of how to forge mutually beneficial long-term relationships.

This proactive and partnership-focused approach to staffing allows us to deliver the highest levels of service to candidates and clients. Our Staffing Professionals offer more than 40 years of experience providing IT and Professional Staffing, Consult to Hire, Direct Hire and Project Based solutions, with a diverse range of clients from small niche organizations to mid-size and Fortune 1000 firms.

We have built our success on the value of partnerships. When it comes to matching the right person for the right job, we know precisely what each candidate has to offer and what the unique requirements are for each position. Our winning track record demonstrates the effectiveness of our partnership approach.

Are you a professional seeking new opportunities to showcase your skills and advance your career? Top Prospect Group is your gateway to exciting challenges and rewarding roles with industry-leading organizations.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Hybrid in Ridgefield, Connecticut

•

6d ago

If you enjoy building scalable data solutions in the cloud and working with cutting-edge tools, this is your chance to make a measurable impact. FT Direct Hire $120K plus benefits Hybrid-4 days on site in CT, 1 day remote Data Engineering, Data Pipelines, Data Modelling, ETL Workflows, Python, Pyspark, SQL, Cloud Platforms, CI/CD processes, Databricks/Apache, AI, Machine Learning Overview Join a growing data team where youll build scalable pipelines and turn complex data into insights that dri

Easy Apply

Full-time

120000

Data Engineer

Greenwich, Connecticut

•

5d ago

Our client is a specialist asset management firm with over $14 billion AUM, specialized in income-oriented credit investments in niche and inefficient markets. As a rapidly growing firm of 140-150+ employees, they are seeking a full-time Data Engineer fully onsite out of their Greenwich, CT office. This is for someone really looking to take that next step. This is a time of high-growth at the firm, having hired many over the past year plus. There is a strong push on their IT initiatives currentl

Easy Apply

Full-time

$140,000 - $200,000

Data Engineer (SQL Stored procedure, Python, Redshift) -- C2H

Stamford, Connecticut

•

Yesterday

Job Role: Data Engineer (Strong SQL, Redshift, Python) Location: Stamford, CT (4 days/week onsite) Hiring-Type: Contract to Hire Job Description: Key Responsibilities: Design, build, and maintain data pipelines, ETL/ELT processes, and backend systems for the new incentive analytics platform Implement and optimize complex incentive calculation logic, performance metrics, and data models Support database restructuring and redesign to improve scalability, data integrity, and performance Develop

Easy Apply

Contract

Depends on Experience

Data Engineer Manager

Stratford, Connecticut

•

Today

Job Description WHAT WE'RE DOING At Sikorsky, we're driving innovation and operational excellence across Rotary Operations and Quality. We're committed to equipping our teams with the best training and resources to deliver top-notch manufacturing performance. This includes creating, delivering, and continuously improving technical training programs that empower our workforce to excel, from new hires to seasoned professionals. THE WORK Strategic Leadership Define and execute an analytics roadma

Full-time

USD 134,000.00 - 236,325.00 per year

Search all similar jobs