Position : Sr AWS Data Engineer with Strong Python/ PySpark : Only USA
Location : Alpharetta GA , Coral Springs FL , Dallas TX , Berkely Heights, NJ
Type of Job : Contract : 12 Months
Experience : 10+ Years
What you will do:
Be part of a team designing, developing, testing, and implementing applications for calculating sales channel residual payments, and associated reporting, analysis, and AI driven intelligence functionality.
• Using Python/PySpark along with AWS provided services, define and implement event-driven data ingestion pipelines, transforming and integrating data sets sourced from multiple platforms and applications.
• Participate in code reviews to ensure adherence to coding standards, security requirements, and engineering best practices.
• Monitor system performance and assist with troubleshooting issues during UAT and post-go live.
Requirements:
• 6+ years of experience in software development, software engineering, data engineering, or related technology disciplines.
• 3+ years of experience developing or supporting applications within AWS data services including S3, Glue, Lambda and related technologies.
• Hands on expertise (minimum 3+ years) with Python
• 3+ years of experience working with SQL databases and data management solutions.
• 3+ years of experience with CI/CD pipelines and DevOps practices
Good to have:
• Experience with commission or residual payment applications
• Experience working with APIs, microservices, and distributed application architectures
• Snowflake experience including data transformations, execution workflows, Snowpark
• Snowflake Cortex for generative AI chatbots of Snowflake housed data and objects