Senior Data Engineer

Python, CI/CD, Athena, RedShift, AWS, SQL Server, ETL, Spark
Full Time
Depends on Experience
Travel required to 25%.

Job Description

Collinwood is assisting our client, one of Chicago's most respected financial services firms (one of "Chicago's Best and Brightest Companies to Work for") in their efforts to hire (or engage) and experienced Senior Data Engineer.
What you will be doing:
- Develop efficient, high throughput data pipelines to push transactional data to the cloud
- Build computation frameworks to get analytical insights from cloud-based data stores
- Optimize storage to best serve business use cases
Define and implement the data life cycle per compliance requirements
- Work with product managers and data scientists to understand the objectives of the data platform
- Play an active role in data governance in collaboration with other Database Administrators and Applications/ Business teams
- Design and develop for quick deployment with assistance from the Devops team
What we need from you:
- Bachelor's degree in MIS, Computer Science, or a related field
- Hands on ETL experience on Apache Spark or AWS Glue
- Hands on experience with an AWS database, preferably Athena or RedShift
- Experience using Python for data science
- Strong knowledge of database design principles
- Strong knowledge of serverless big data offerings on AWS
- Very good understanding of CI/CD pipelines and infrastructure as code
- Knowledge/experience adding quality checks to data pipelines
- 7+ years of experience in design, development, and maintenance of cloud-based data systems
- 3+ years of experience on Microsoft SQL server
- Great communication skills, both verbal and written
Also nice for you to have the:
-Ability to work independently, communicate effectively, and produce superior results
-Experience working in Scrum-based methodologies
-Ability to write clean code and provide insights in code reviews

Dice Id : 90812961
Position Id : 7130782
Originally Posted : 1 month ago
Have a Job? Post it