Senior Cloud Data Engineer

Job Description: Senior Cloud Data Engineer / Data Platform Engineer

Location: Cincinnati, OH
Experience: 10+ Years
Primary Technologies: Microsoft Azure, Python
Methodology: Agile / Scrum
Domain: Retail (Preferred)

Role Summary:

The Senior Cloud Data Engineer / Data Platform Engineer will play a critical role in designing, building, and maintaining scalable, cloud-based data platforms and distributed data processing solutions. This role requires strong ownership of work items across the full SDLC, deep expertise in Python and Azure, and a passion for building reliable, observable, and high-quality data pipelines. The ideal candidate will also bring a mentoring mindset and a continuous improvement attitude.

Key Responsibilities:

• Own user stories and drive them to completion through all phases of the 84.51 SDLC.
• Design and develop distributed data processing and data pipeline solutions.
• Orchestrate complex, multi-step data transformation pipelines.
• Build transformation logic using object-oriented programming principles.
• Perform unit, integration, and regression testing on packaged code.
• Enhance and maintain CI/CD pipelines through the path to production.
• Implement data quality checks for ingested and post-processed data.
• Ensure data observability through monitoring, alerting, and logging of automated pipelines.
• Maintain and enhance existing data applications and platform components.
• Provision and manage cloud resources using Infrastructure as Code (IaC).
• Participate in Agile ceremonies, including sprint planning, retrospectives, and estimations.
• Mentor junior engineers and contribute to team skill development.
• Bring innovative perspectives to problem-solving and continuously improve engineering practices.

Required Skills & Qualifications:

Education

• Bachelor’s degree in Computer Science, Management Information Systems, Mathematics, Business Analytics, or a related technical discipline.

Technical Skills:

• 10+ years of overall professional experience in software and data engineering.
• 2+ years of hands-on professional data development experience.
• 2+ years of experience developing complex SQL queries.
• Strong proficiency in Python and Python-based frameworks.
• Strong understanding of Object-Oriented Programming (OOP) and SOLID principles.
• Experience with distributed data processing using PySpark and/or Snowpark.
• Proficiency in data pipeline orchestration tools and frameworks.
• Experience implementing data quality checks and data observability solutions.
• Hands-on experience with automated testing frameworks (PyTest or similar).
• Strong experience with CI/CD pipelines and DevOps practices.
• Proficiency with version control systems such as Git and GitHub.
• Experience with dependency management tools (Conda, virtualenv, etc.).
• Experience debugging and performance tuning enterprise-scale applications.
• Strong understanding of Infrastructure as Code (IaC) concepts and tools.
• Hands-on experience with cloud platforms, preferably Microsoft Azure (AWS or Google Cloud Platform acceptable).
• Working knowledge of Agile/Scrum methodologies.

Preferred / Desirable Skills:

• Experience with Java and Spring Framework.
• Knowledge of the Retail domain.
• Experience building and supporting enterprise-scale data platforms.