Lead Data Engineer

Overview

Remote
Hybrid
Depends on Experience
Full Time
Able to Provide Sponsorship

Skills

Agile
Amazon S3
Amazon Web Services
Analytical Skill
Apache Spark
Big Data
Cloud Computing
Collaboration
Communication
Conflict Resolution
Continuous Delivery
Continuous Integration
Data Engineering
Data Governance
Data Integrity
Data Migration
Data Modeling
Data Processing
Data Storage
Data Warehouse
Debugging
DevOps
Electronic Health Record (EHR)
Extract
Transform
Load
Git
Jenkins
Leadership
Mentorship
Problem Solving
Python
Regulatory Compliance
SQL
Snow Flake Schema

Job Details

Job Title: Lead Data Engineer
Location: Jersey City (4 Days Onsite 1 day Remote)
Type: Fulltime
Job Title: Lead Data Engineer
Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts
Responsibilities:
  • Lead the design, development, and implementation of data solutions using AWS and Snowflake.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines, ensuring data quality, integrity, and security.
  • Optimize data storage and retrieval processes to support data warehousing and analytics.
  • Provide technical leadership and mentorship to junior data engineers.
  • Work closely with stakeholders to gather requirements and deliver data-driven insights.
  • Ensure compliance with industry standards and best practices in data engineering.
  • Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.
Must have:
  • 10+ years of relevant experience in Data Engineering and delivery.
  • 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations - AWS in particular
  • Strong experience being a hands-on lead for a team of 4+ members atleast.
  • Strong experience with SQL, python and Pyspark
  • Good understanding of Data ingestion and data processing frameworks
  • Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
  • Good aptitude, good communication skill, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
  • Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
  • Experience working in Agile Methodology
Good to have:
Have experience in DevOps tools (Jenkins, GIT etc.) and practices, continuous integration, and delivery (CI/CD) pipelines.
Worked on cloud implementations, data migration, Data Vault 2.0, etc.
Requirements:
  • Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
  • Strong understanding of data warehousing concepts and best practices.
  • Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Experience in the insurance industry, preferably with knowledge of claims and loss processes.
  • Proficiency in SQL, Python, and other relevant programming languages.
  • Strong problem-solving skills and attention to detail.
  • Ability to work independently and as part of a team in a fast-paced environment.
Preferred Qualifications:
  • Experience with data modeling and ETL processes.
  • Familiarity with data governance and data security practices.
  • Certification in AWS or Snowflake is a plus.


Thanks and Regards
Sanket Parate

Talent Acquisition Specialist, KTEK Resourcing

Phone
Email -

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About K-Tek Resourcing LLC