Resource 1 is in need of a Sr. AWS/Databricks Data Engineer with at least 5 years of experience for a 6-12-month contract-for-hire with our client in the north suburbs. Individual will need to be local and able to work onsite at the Northfield location 3 days per week. The ideal candidate will have experience developing and optimizing Amazon Redshift-based Enterprise Data Warehouse (EDW) solutions. The selected individual will work closely with cross-functional teams, including data engineers, analysts, and business stakeholders, to ensure the successful implementation of data models, ETL pipelines, and data processing.
Responsibilities:
· Develop and maintain data and cloud solutions leveraging Databricks and AWS technologies.
· Design and build solutions from scratch, applying strong software development, architecture, and technical design principles.
· Apply strong problem-solving and critical-thinking skills to troubleshoot complex technical issues and identify opportunities for improvement.
· Design/ implement scalable data models and architecture using Redshift.
· Work with business and data teams to translate requirements into data models.
· Develop and optimize SQL queries and stored procedures.
· Develop/ maintain ETL pipelines to ingest and process data into Redshift data warehouse from various data sources, including Salesforce.com, Dynamics 365, etc.
· Ensure smooth data integration from multiple sources, including cloud-based and on-prem.
· Monitor performance of Redshift environment and optimize queries, tables, indexes, etc.
· Utilize Redshift best practices to optimize query performance.
· Ensure data integrity, quality, and consistency across the EDW (Enterprise Data Warehouse).
· Document data models, ETL processes, and Redshift configurations.
· Troubleshoot issues related to data extraction, transformation, and loading processes.
Required Skills:
· 5+ years of experience in designing, developing, and optimizing data solutions using AWS.
· Experience with AWS S3 and other AWS services for data storage and processing.
· Strong hands-on experience with Databricks, with the ability to understand and work through complex data and technical concepts.
· Strong experience with SQL, including complex queries, stored procedures, and functions.
· Knowledge of data modeling best practices (logical, star schema, snowflake schema).
· Experience with business intelligence/ data visualization tools (Power BI, Tableau, AWS QuickSight, etc.).
· Prior experience using ServiceNow for building, configuring, and testing new releases.
· Understanding of database optimization techniques (e.g., indexing and query optimization).
· Strong problem-solving skills, including the ability to independently investigate issues, evaluate alternatives, and determine effective solutions.
· Demonstrated technical aptitude, creativity, and ability to learn and apply new technologies.
Medical insurance and a 401(k) plan is offered to all eligible W2 employees.
Never miss an opportunity! Create an alert based on the job you applied for.