Sr. AWS/Databricks Data Engineer

Resource 1 is in need of a Sr. AWS/Databricks Data Engineer with at least 5 years of experience for a 6-12-month contract-for-hire with our client in the north suburbs. Individual will need to be local and able to work onsite at the Northfield location 3 days per week. The ideal candidate will have experience developing and optimizing Amazon Redshift-based Enterprise Data Warehouse (EDW) solutions. The selected individual will work closely with cross-functional teams, including data engineers, analysts, and business stakeholders, to ensure the successful implementation of data models, ETL pipelines, and data processing.

Responsibilities:

·         Develop and maintain data and cloud solutions leveraging Databricks and AWS technologies.

·         Design and build solutions from scratch, applying strong software development, architecture, and technical design principles.

·      Apply strong problem-solving and critical-thinking skills to troubleshoot complex technical issues and identify opportunities for improvement.

·         Design/ implement scalable data models and architecture using Redshift.

·         Work with business and data teams to translate requirements into data models.

·         Develop and optimize SQL queries and stored procedures.

·    Develop/ maintain ETL pipelines to ingest and process data into Redshift data warehouse from various data sources, including Salesforce.com, Dynamics 365, etc.

·         Ensure smooth data integration from multiple sources, including cloud-based and on-prem.

·         Monitor performance of Redshift environment and optimize queries, tables, indexes, etc.

·         Utilize Redshift best practices to optimize query performance.

·         Ensure data integrity, quality, and consistency across the EDW (Enterprise Data Warehouse).

·         Document data models, ETL processes, and Redshift configurations.

·         Troubleshoot issues related to data extraction, transformation, and loading processes.

Required Skills:

·         5+ years of experience in designing, developing, and optimizing data solutions using AWS.

·         Experience with AWS S3 and other AWS services for data storage and processing.

·    Strong hands-on experience with Databricks, with the ability to understand and work through complex data and technical concepts.

·         Strong experience with SQL, including complex queries, stored procedures, and functions.

·         Knowledge of data modeling best practices (logical, star schema, snowflake schema).

·         Experience with business intelligence/ data visualization tools (Power BI, Tableau, AWS QuickSight, etc.).

·         Prior experience using ServiceNow for building, configuring, and testing new releases. 

·         Understanding of database optimization techniques (e.g., indexing and query optimization).

·    Strong problem-solving skills, including the ability to independently investigate issues, evaluate alternatives, and determine effective solutions.

·         Demonstrated technical aptitude, creativity, and ability to learn and apply new technologies.

Medical insurance and a 401(k) plan is offered to all eligible W2 employees.