Senior Data Engineer

Job Title : Senior Data Engineer

Location: Chicago, IL (Hybrid)

Job Description :

PURPOSE:
The Senior Data Engineer will design, code, test, and analyse software programs and applications.

This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle.

This role will also analyse and amend software errors in a timely and accurate fashion and provide status reports where required.

The position responsibilities outlined below are not all encompassing. Other duties, responsibilities, and qualifications may be required and/or assigned, as necessary.

POSITION RESPONSIBILITIES:

• Work with Product team to determine requirements and propose approaches to address users' needs.
• Analyse requirements to determine approach/proposed solution.
• Design and Build Solutions using relevant programming language
• Thoroughly test solutions using relevant approaches and tools
• Conduct research into software-related issues and products
• Bring out-of-box thinking and solutions to address challenging issues
• Effectively prioritize and execute tasks in a fast-paced environment
• Work both independently and in a team-oriented, collaborative environment
• Flexible and adaptable to learning and understanding new technologies
• Highly self-motivated and directed
• Demonstrate a commitment to Client core values
• Exercise independent judgment in methods and techniques for obtaining results.
• Work in an agile/scrum environment.

Experience and Qualifications:

• Strong experience with Snowflake for cloud data warehousing, data modelling, performance optimization, and SQL development
• Hands-on experience with Airflow for workflow orchestration, scheduling, monitoring, and management of data pipelines.
• Experience with ThoughtSpot for self-service analytics, reporting, dashboard development, and business intelligence solutions.
• Proficiency in SQL and data integration technologies.
• Experience designing and implementing scalable ETL/ELT pipelines in cloud environments.
• Strong understanding of data warehousing concepts, dimensional modelling, and data governance best practices.
• Experience working with large-scale datasets and supporting analytical reporting requirements.
• Ability to collaborate with business stakeholders, data analysts, and engineering teams to deliver data-driven solutions.
• Experience and comfort solving problems in an ambiguous environment where there is constant change.
• Have the tenacity to thrive in a dynamic and fast-paced environment, inspire change, and collaborate with a variety of individuals and organizational partner
• Experience designing and building scalable and robust data pipelines to enable data-driven decisions for the business
• Very good understanding of the full software development life cycle
• Very good understanding of Data warehousing concepts and approaches
• Experience in building Data pipelines and ETL approaches using Informatica IICS, Alteryx or any leading pipeline tool.
• Experience in building high-volume data workflows in a cloud environment
• Experience in building Data warehouse and Business intelligence projects
• Good Experience using Snowflake environment.
• Good Experience using streaming data using Kafka.
• Experience in data cleansing, data validation and data wrangling.
• Hands-on experience in AWS cloud and AWS native technologies such as Glue, Lambda, Kinesis, Lake Formation, S3, Redshift
• Experience using Spark EMR, RDS, EC2, Athena, API capabilities, CloudWatch, CloudTrail is a plus
• Experience with Business Intelligence tools like Tableau, Cognos, ThoughtSpot, etc is a plus.
• Experience in one of the scripting languages: Python or Unix Scripting Proficient in SQL, PL/SQL, relational databases (RDBMS), database concepts and dimensional modelling
• Strong verbal and written communication skills
• Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments.
• Resources should be able work along with On-site hours to participate in Req/Design discussions

Education:

• bachelor s degree in engineering, Computer Science, Statistics, Economics, Mathematics, Finance, or a related quantitative field.
• 5 to 8+ years of experience within the field of data engineering or related technical work including business intelligence, analytics..

Equal opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.