Data Solution Engineer with Snowflake/Databricks - Fulltime Role

Role: Data Solution Engineer (Snowflake/Databricks)

Location: Buffalo, NY (Onsite)

Duration: Long Term - Fulltime

Visa: Independent Visa's
Job description:

• Seeking an experienced Solution Engineer to support a large-scale Teradata migration to modern cloud data platforms, including Snowflake and Databricks.
• You will design and build data solutions that power commercial, marketing, and finance data use cases while ensuring performance, cost efficiency, and compliance.

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on Snowflake and Databricks.
• Implement medallion architecture (Bronze/Silver/Gold) for batch and streaming data.
• Build CDC and streaming data integrations to support near real-time use cases.
• Develop high-quality Python/PySpark and SQL code for data transformation and analytics.
• Support platform migration activities from Teradata to Snowflake/Databricks, including validation and cutover.
• Contribute to CI/CD pipelines and automated testing (e.g., PyTest).
• Optimize workloads for performance and cloud cost, leveraging Azure capabilities.
• Collaborate with Solution Architects and business stakeholders to translate requirements into technical solutions.
• Adhere to Agile practices, participating in sprint planning, standups, and reviews.
• Ensure all solutions comply with financial services regulatory and security expectations.

Required Skills & Experience:

• 6 8 years of experience in data engineering, data platforms, or related roles.
• Hands-on experience with Snowflake and Databricks in production.
• Strong proficiency in Python and PySpark for data engineering workloads.
• Advanced SQL skills, including complex queries and performance tuning.
• Experience implementing medallion architecture and layered data models.
• Practical experience with CDC and streaming technologies/concepts.
• Working experience with Azure as the underlying cloud platform.
• Exposure to cost optimization practices on cloud data platforms.
• Experience working in Agile teams with CI/CD, Git, and automated testing.
• Background in financial services or other regulated environments.

Nice to Have:

• Direct experience migrating from Teradata or other legacy warehouses to cloud platforms.
• Hands-on use of Unity Catalog and/or Apache Iceberg.
• Experience in application development and integrating data into downstream apps/APIs.
• Familiarity with data governance, data quality, and data management best practices.

Education:

• Bachelor s degree in Computer Science, Information Technology, Engineering, or related field, or equivalent experience.

Key Competencies:

• Strong problem-solving and analytical thinking.
• Ability to explain complex technical topics to non-technical stakeholders.
• Ownership mindset with focus on delivery, quality, and stability.
• Collaborative working style in cross-functional teams.