Overview
Skills
Job Details
Job Title: Python PySpark/ Data Engineer 10 years exp must
Location: Columbus, OH and Jersey City, NJ 5 days onsite role
Long Term Project
Job Description:
6+ years of professional work experience designing and implementing data pipelines in a cloud environment is required.
5+ years of experience migrating/developing data solutions in the AWS cloud is required.
2+ years of experience building/implementing data pipelines using Databricks or similar cloud database.
Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
Hands-on object-oriented programming experience using Python is required.
Professional work experience building real-time data streams using Spark and Experience in Spark.
Knowledge or experience in architectural best practices in building data lakes