ECCO Select is a talent acquisition and consulting company specializing in people, process and technology solutions. We provide the talent behind the technology enabling our clients to achieve their goals. For more information about ECCO Select, visit us at .
Position Title: Lead Data Engineer
Location Information
Hybrid – 2-3 days onsite in Atlanta, GA or Dallas, TX
Position Responsibilities:
As a Lead Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and the Snowflake data platform on AWS. You will collaborate with cross-functional teams—including data analysts, BI developers, application engineers, and business stakeholders—to ensure the delivery of well-modeled, trustworthy data that serves analytics, reporting, and business intelligence needs. Your combined hands-on technical expertise and leadership will ensure that data assets are reliable, performant, and secure.
Key responsibilities include:
- Designing and building batch and near-real-time data pipelines on AWS using services such as S3, Glue, Lambda, and Step Functions.
- Developing and maintaining Snowflake data models—across raw, staging, and reporting layers—to support analytics and reporting.
- Loading and transforming data in Snowflake, utilizing Snowpipe, Streams and Tasks, and external stages for automation and efficiency.
- Integrating data from internal applications, SaaS platforms, and third-party sources through APIs and file-based feeds.
- Performing Snowflake performance tuning/cost optimization by managing warehouse sizing, query optimization, and usage monitoring.
- Building data quality checks, monitoring systems, and alerting mechanisms to proactively identify and resolve data pipeline failures and issues.
- Applying data security and governance best practices, including role-based access controls and data masking for compliance and confidentiality.
- Collaborating with application teams working on .NET-based systems to source data, implement integrations, and ensure data reliability.
- Documenting data flows, data models, and pipeline processes, and participating in code reviews for continuous improvement.
Essential Skills, Experience
To excel in this role, you will need the following expertise and qualities:
- 8+ years of hands-on data engineering experience, with a minimum of 2 years in a technical lead or supervisory capacity.
- Extensive experience with Snowflake, including end-to-end data modeling, SQL development, and performance optimization/tuning.
- Demonstrated experience with AWS data services, specifically S3, Glue, Lambda, and Step Functions, in a production environment.
- Advanced SQL expertise and a strong understanding of data warehousing fundamentals, such as dimensional modeling and ELT best practices.
- Working proficiency with C#/.NET, including reading, supporting, or building data integrations with .NET-based applications.
- Familiarity with Git for version control and best practices in continuous integration/continuous deployment (CI/CD).
- Excellent communication skills and an ability to work collaboratively across diverse technology and business teams.
- Bachelor’s degree in Computer Science, Engineering, or a related technology field—or equivalent professional experience.
Qualifications:
- Experience with dbt, Python, or Airflow preferred.
- Familiarity with infrastructure-as-code practices using Terraform or CloudFormation is a plus.
- Exposure to reporting and BI tools such as Power BI, Tableau, or others that integrate with Snowflake.
- Background in events, hospitality, or customer engagement data is an advantage.
- Relevant technical certifications—such as SnowPro Core or AWS Data Engineer (Associate)—are desirable.
ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities.
