Job Title: Sr Data Engineer
Experience: 6+ Years
Location: Pittsburgh
Job Summary:
We are looking for an experienced Lead Data Engineer to drive the design and delivery of scalable data platforms and pipelines. This role requires strong expertise in Python, SQL, and modern data engineering practices, along with the ability to lead teams, define standards, and implement DevOps-driven data workflows.
Key Responsibilities:
· Lead the design and implementation of scalable ETL/ELT pipelines and data architecture
· Define best practices and standards for data engineering, code quality, and performance optimization
· Own end-to-end delivery of data pipelines, ensuring reliability, scalability, and maintainability
· Build and optimize frameworks for data ingestion, transformation, and processing of large datasets
· Drive implementation of CI/CD and DevOps practices across data engineering workflows
· Oversee automation for data pipeline deployment, monitoring, and alerting
· Collaborate with business and technology stakeholders to translate requirements into scalable solutions
· Mentor and guide junior engineers; conduct code reviews and provide technical leadership
· Lead troubleshooting, root cause analysis, and performance tuning across data platforms
Must-Have Skills:
· Strong hands-on experience in Python and SQL with the ability to guide others
· Deep understanding of data engineering concepts (ETL/ELT, data modeling, warehousing)
· Proven experience designing and leading production-grade data pipelines and platforms
· Strong exposure to DevOps practices and tools (Git, CI/CD pipelines, Jenkins, Docker)
· Experience with system design, scalability, and performance optimization
· Strong problem-solving skills with ownership mindset
Good to Have:
· Experience with PySpark or large-scale data processing frameworks
· Exposure to cloud data platforms (AWS, Azure, or Google Cloud Platform)
· Experience with workflow orchestration tools (e.g., Airflow)
· Understanding of data governance, data quality, and lineage frameworks