Lead Data Engineer

St. Paul, MN, US • Posted 4 hours ago • Updated 4 hours ago
Full Time
On-site
USD $49.00 - 85.00 per hour
Company Branding Image
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • Clarity
  • Collaboration
  • High Availability
  • Analytics
  • Management
  • Data Flow
  • Snow Flake Schema
  • Microsoft Azure
  • Storage
  • DevOps
  • Continuous Integration
  • Continuous Delivery
  • Modeling
  • Offshoring
  • Machine Learning (ML)
  • Generative Artificial Intelligence (AI)
  • Use Cases
  • Privacy
  • Meta-data Management
  • Innovation
  • Artificial Intelligence
  • Job Boards

Summary

Join our team as a Lead Data Engineer, where you'll spearhead technical execution and provide architectural guidance across diverse engineering teams. This role offers a unique opportunity to influence the standards for a modern data stack centered on Snowflake and Azure.
Responsibilities
  • Lead technical efforts for distributed teams, ensuring clarity and high standards across time zones.
  • Collaborate with Product Owners and Solution Architects to design optimal data pipelines.
  • Develop systems for high availability and fault tolerance to ensure platform resilience.
  • Engineer and optimize data pipelines using Fivetran, Snowflake, and dbt for large-scale datasets.
  • Implement metadata-driven pipelines to enhance development speed and reduce manual tasks.
  • Apply advanced modeling techniques to create high-performance datasets for analytics and AI.
  • Optimize Snowflake performance to minimize latency and reduce costs.
  • Ensure platform reliability through end-to-end observability and rigorous quality checks.
  • Manage data flows within the Azure ecosystem, leveraging Azure DevOps and related services.
Skills
  • Extensive experience in building and optimizing complex data architectures and pipelines.
  • Expert-level proficiency in Snowflake, dbt, and Fivetran.
  • Strong skills in Azure services, including Storage, Compute, and DevOps/CI/CD.
  • Proven ability to engineer layered data frameworks using various modeling methodologies.
  • Experience in guiding offshore teams and conducting technical code reviews.
Preferred Skills
  • Experience in building data foundations for Machine Learning and Generative AI use cases.
  • Knowledge of automated data privacy/masking and advanced metadata cataloging.

At Horizontal, we are committed to fostering a diverse and inclusive workplace where everyone feels valued and respected. We believe that diversity drives innovation and are dedicated to creating an environment that reflects the diverse communities we serve.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.

Please apply through this online posting or by visiting our Job Board at Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $49 - $85 per hour based on qualifications and experience.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10123528
  • Position Id: 74504
  • Posted 4 hours ago

Company Info

About Horizontal Talent

Horizontal Integration offers two service lines. Our staffing agency places IT, digital and creative talent in both contract and permanent roles. Our digital agency provides digital marketing strategy and technology consulting on a project basis. Many of our clients take advantage of both service lines.

We are a certified Minority Business Enterprise, with more than 200 employees across our offices in Minneapolis, Denver, Dallas and Vadodara, India. We ve been consistently growing and profitable since the company was founded in 2003.

Honors:
Recognized as a "2009 Best Place to Work" by Minneapolis/St.Paul Business Journal.

Fact:
Our people and our organization are deeply rooted in IT and interactive marketing.

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us. All applicants applying must be legally authorized to work in the country of employment.

About_Company_OneAbout_Company_Two
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Minneapolis, Minnesota

Today

Full-time

USD 47.00 - 82.00 per hour

Minneapolis, Minnesota

Today

Full-time

Compensation information provided in the description

Maplewood, Minnesota

Today

Full-time

Compensation information provided in the description

Brooklyn Park, Minnesota

Today

Full-time

Compensation information provided in the description

Search all similar jobs