Senior Data Engineer

Job Title: Senior Data Engineer

Location: Remote (Prefer PST working hours)

Key Responsibilities:

• Design, develop, and optimize scalable data pipelines and workflows.
• Work with structured and semi-structured data using Python, PySpark, SQL, and AWS services (Athena, Redshift, Glue Jobs, S3).
• Integrate and transform data for reporting and analytics using DBT (Data Build Tool).
• Develop ETL/ELT pipelines leveraging Informatica and Snowflake for high-performance data processing.
• Collaborate with stakeholders from the Insurance domain to understand data needs and translate them into technical solutions.
• Implement and maintain data models and pipelines to support business intelligence and machine learning use cases.
• Ensure data quality, consistency, and governance across all systems.

Technical Skills Required:

• Strong experience in Python and SQL for data transformation.
• Hands-on experience with AWS:
• S3, Redshift, Athena, Glue Jobs
• Experience with DBT (Data Build Tool) for data transformation and modeling.
• PySpark development for large-scale data processing.
• Informatica for enterprise-level ETL workflows.
• Working knowledge of Snowflake: data modeling, SQL optimization, and integration.
• Experience with data lake/data warehouse architecture.

Domain Expertise:

• Solid understanding and past project experience in the Insurance domain (Health, Life, or P&C preferred).

Preferred Qualifications:

• Bachelor's or Master's in Computer Science, Information Systems, or related field.
• Strong problem-solving and analytical skills.
• Ability to work in a fast-paced, team-oriented environment.
• Excellent communication and documentation skills.