Position :: Data Engineer
Location :: Berwyn PA- Onsite
Long Term Contract
Only W2
The Data Engineer will play a critical implementation role on the Data Engineering and Data Products team and be responsible for data pipeline solutions design and development, troubleshooting, and optimization tuning on the next generation data and analytics platform being developed with leading edge big data technologies in a highly secure cloud infrastructure. The Data Engineer will serve as a liaison to platform user groups ensuring successful implementation of capabilities on the new platform.
Candidate Requirements
Experience in the following Should have: -
SQL, Python, PySpark, Python ML libraries.
Data and analytics technologies including SQL/NoSQL/Graph databases, ETL
Knowledge of CI/CD and related tools such as Gitlab,
AWS services including EMR, Glue, Athena, Batch, Lambda CloudWatch, DynamoDB, EC2, CloudFormation, IAM
Snowflake and Airflow.
DBT
Canonical Data Models and Medallion Architecture.
Solid scripting skills (e.g., bash/shell scripts, Python)
Candidate should be able to gather and interpret business requirements
Experience with agile delivery methodologies using Jira or similar tools
Experience working with remote teams