Snowflake & Hadoop Lead- Full-time role

Hybrid in Milton, GA, US • Posted 18 hours ago • Updated 18 hours ago
Full Time
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Snowflake
  • Hadoop Migration
  • Python
  • Apache Spark

Summary

Job Description: Snowflake & Hadoop Lead

Location: Alpharetta, GA (Hybrid – 3 Days Onsite per Week)

Full-time role

 

Key Responsibilities

Hadoop Development & Migration

  • Design, develop, and implement Hadoop MapReduce jobs for complex data processing requirements.
  • Work with HDFS, Hive, and HiveQL to query, process, and manage large datasets.
  • Leverage Apache Spark and PySpark for distributed data processing and streaming analytics.
  • Lead and support migration of Hadoop-based data platforms and workloads to Snowflake.
  • Analyze existing Hadoop environments and develop efficient migration strategies.

Snowflake Development

  • Design and implement scalable data models using Snowflake.
  • Develop complex SQL queries to extract, transform, and analyze large datasets.
  • Create and optimize Snowflake views and materialized views for improved query performance.
  • Implement Snowflake performance tuning and query optimization techniques.
  • Work with Snowpark and Snowspark for advanced data processing.
  • Establish data governance, data quality, and security practices within Snowflake.

Data Engineering & Leadership

  • Design and implement scalable data ingestion and transformation pipelines.
  • Ensure data accuracy, consistency, quality, and security across data platforms.
  • Collaborate with cross-functional teams to understand business requirements and deliver data solutions.
  • Provide technical leadership and guidance on Snowflake and Hadoop development initiatives.

Required Technical Skills

  • Very strong hands-on experience with Snowflake.
  • Strong experience in Hadoop-to-Snowflake migration.
  • Strong programming skills in Python, Java, and SQL.
  • Deep understanding of the Hadoop ecosystem:
    • HDFS
    • MapReduce
    • Hive / HiveQL
    • Apache Spark
    • PySpark
  • Strong knowledge of Snowflake architecture, data warehousing, and query optimization.
  • Experience with Snowpark / Snowspark.
  • Strong understanding of data ingestion, ETL/ELT, and data transformation.
  • Experience in data modeling, data quality, governance, and data security.

Required Experience

  • 7+ years of overall IT experience.
  • Strong hands-on Snowflake development experience.
  • Proven experience leading or supporting Hadoop migration projects.
  • Experience working with large-scale data processing and enterprise data warehouse solutions.
  • Ability to work in a hybrid environment (3 days onsite per week).

Preferred Candidate Profile

  • Strong technical expertise in Snowflake and Big Data technologies.
  • Experience in Financial Services or Banking environments is an advantage.
  • Excellent problem-solving, communication, and collaboration skills.
  • Ability to take ownership of technical deliverables and lead data engineering initiatives.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10459902
  • Position Id: 1473-22664-1794861809
  • Posted 18 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.