Software Engineering Solution Support (Python)

Job Description:

• We are seeking a hands-on, experienced Software Engineer with strong expertise in Python, Python automation, and GitLab automation to integrate with cross-functional program and solution delivery teams.
• This role involves designing, developing, and maintaining robust, efficient data pipelines to ingest, transform, catalog, and deliver curated, high-quality data from diverse sources.
• The candidate will help build common structures and reusable libraries, while promoting best practices such as automated testing, code reviews, and documentation.
• Responsibilities include troubleshooting issues during testing and validation, supporting data migration efforts, and working within a CI/CD pipeline environment on an AWS-based technology stack.
• Experience with Databricks, and collaboration with DevOps, database teams, and data modeling efforts, is highly preferred.

Required Skills:

• Experienced and Proficiency in Python, Python automation, GitLab, GitLab automation, data modeling using Databricks, and AWS is required. Experience with Starburst, Immuta, Collibra, Alteryx, Tableau, and unit testing is a plus. The ideal candidate will have a background in corporate DevOps environments, with hands-on experience in automated deployments and unit testing.
• Experienced and Proficiency in Python, Python automation, GitLab, GitLab automation, and AWS is required.

Job Duties:

• Use Python to implement repeatable automated operations to migrate data.
• Perform GitLab automation.
• Lead adoption of best practices such as automated testing, documentation, and code reviews.
• Proactively troubleshoots and resolve issues during testing and validation activities.
• Completed assigned stories to include the following:
• Design
• Structured query language (“SQL”) orchestration
• Data ingestion pipeline builds
• Coding to include pair programming
• Code reviews
• Documentation including data models
• Automated tests
• Automation, logging, and alerting
• Troubleshooting and defect resolution
• Support data migration
• Experience with the cloud stack.
• Deploying monitoring and alerting for data pipelines, data stores and implementing auto remediation wherever possible to ensure the availability and reliability of data systems.
• Employing security, testing and automation first strategy and adhering to data engineering best practices.

Desired Skills & Experience

• 5 to 8 Years of Experience with Proficiency in Python, Python automation, GitLab, GitLab automation, data modeling using Databricks, and AWS is required.
• Experience with data modeling using Databricks, Starburst, Immuta, Collibra, Alteryx, Tableau, and unit testing is a plus.
• The ideal candidate will have a background in corporate DevOps environments, with hands-on experience in automated deployments and unit testing.