Overview
HybridThis position is open to remote candidates, but could require quarterly travel to Columbia, SC.
Depends on Experience
Contract - W2
Skills
Data Engineering
AWS
Python
Spark
Scala
Job Details
Hansen Talent Group is seeking a Senior Data Engineer with strong AWS data warehousing experience to join a great data driven team! This position is open to remote candidates, but could require quarterly travel to Columbia, SC.
The Senior Data Engineer will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery and production implementation.
Duties:
- Deliver digestible, contemporary and immediate data content to support and drive business decisions
- Involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes
- Review functional and technical designs to identify areas of risk and/or missing requirements
- Create ETL processes using PySpark and Scala.
- Build applications using Python, SQL, Databricks and AWS
- Contribute to the exploration and understanding of new tools and techniques, and propose improvements to the data pipeline
Qualifications:
- 8+ years working with Large Data Lakes as a Data Engineer
- Hands-on experience with AWS computational technologies, AWS storage, Spark, Scala, Python