Overview
Skills
Job Details
Job Title: Data Engineer
Location: West Chester, PA
Hire Type: Long Term Contract
Primary Skill Set Python, Pyspark + Strong SQL, Apache Nifi
Good to Have Databricks, MongoDB & Tableau
Language: Python, PySpark, SQL (advanced), Scala (nice to have)
Database: Relational (Oracle, Postgres,etc. ), NoSQL (MongoDB, Cassandra. Etc)
Tools: Spark, Databricks, Hadoop, Kafka, Airflow, Apache NiFi (any 2 3)
Cloud Platforms: AWS, or Azure or Google Cloud Platform
Good to Have
Reporting Tools: PowerBI, Tableau, Etc.
Others: CICD, Git, Data Pipelines, Performance Optimization, etc.
AI / ML: Must be trained in AI Augmented development using Copilot & Other LLMs. Should be comfortable adopting GenAI in all phase of SDLC.
Advanced troubleshooting skills & Experience with logging and monitoring tools like Kibana to trace logs of microservices/APIs for interactions between external systems.