We are seeking an experienced Data Engineer with strong expertise in Python, AWS Glue, ETL development, and Annuity/Insurance domain knowledge. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ETL workflows, and cloud-based data integration solutions. Candidates with experience in financial services, insurance, or annuity products are highly preferred.
Key Responsibilities
Design, develop, and maintain scalable ETL pipelines using Python and AWS Glue.
Build and optimize data ingestion, transformation, and processing workflows.
Develop data integration solutions for structured and unstructured data sources.
Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
Work with large datasets to ensure data quality, consistency, and integrity.
Optimize ETL jobs for performance, scalability, and cost efficiency.
Develop and maintain data models and data warehouse solutions.
Perform data validation, troubleshooting, and root cause analysis.
Support production environments and resolve data-related issues.
Create technical documentation, data flow diagrams, and operational procedures.
Follow Agile methodologies and participate in sprint planning, code reviews, and testing.
Required Skills
Programming & ETL
Python
AWS Glue
ETL Development
PySpark
SQL
Data Transformation
Data Cleansing
Data Validation
Cloud Technologies
AWS Glue
Amazon S3
AWS Lambda
Amazon Redshift
AWS IAM
CloudWatch
Databases
SQL Server
Oracle
PostgreSQL
MySQL
Big Data (Preferred)
Apache Spark
Hadoop
Hive
Data Integration
REST APIs
JSON
XML
Batch & Real-Time Data Processing
Domain Experience
Annuity
Insurance
Financial Services
Retirement Products
Policy Administration Systems
Qualifications
Bachelor''s degree in Computer Science, Information Technology, Engineering, or a related field.
5+ years of experience in Data Engineering or ETL Development.
Strong hands-on experience with Python and AWS Glue.
Experience building cloud-based ETL pipelines and data integration solutions.
Solid SQL and database development experience.
Strong understanding of data warehousing concepts and ETL best practices.
Experience working in Agile/Scrum environments.
Excellent analytical, communication, and problem-solving skills.
.jpg%3Fformat%3Dwebp&w=1080&q=75)
Never miss an opportunity! Create an alert based on the job you applied for.