Data Engineer / Software Developer

Role: Data Engineer / Software Developer

Location: Need local to Naperville, IL (US). Hybrid role 3 days onsite, 2 days remote.

Visa: All(except OPT/CPT)

Experience: 12+
 

About the role
We’re looking for a data engineer to develop and maintain the core selection engine that powers our direct mail marketing campaigns. 
This platform is responsible for selecting millions of customer prospects applying complex business rules, generating campaign’s 
segments, and producing final mailing selections used across the business.
You’ll work at the intersection of software engineering, data engineering, and marketing operations, building scalable configurable 

pipelines that allow marketers to define sophisticated campaign logic while ensuring selections remain accurate, reproducible, and 
performant. This role will entail building production-quality software, which is readily testable, maintainable, and extensible as part of a 
small team.
This is a highly technical role involving large scale data processing, software architecture, and optimization rather than traditional 
analytics. A keen eye for detail is required for this role as small errors in data processing for direct mail can be very costly.

Responsibilities
• Design, build, and maintain the direct mail campaign selection engine.
• Develop configurable rule-based systems for customer and household selection.
• Implement campaign eligibility, suppression, prioritisation and segmentation logic
• Build reusable components that allow new campaign rules to be added with minimal code changes
• Optimise selection pipelines to process millions of records with low runtime
• Integrate predictive model outputs into campaign decisioning
• Create robust validation and quality assurance checks for campaign outputs
• Maintain documentation for configurations and data flows
• Write a comprehensive test suite covering unit testing, regression testing, and snapshot testing

Technical skills
Essential
• Expert knowledge of Python and its standard library
• Strong OOP skills, including inheritance, composition, polymorphism, and abstraction
• Experience designing clean, extensible class hierarchies and APIs
• Writing modular, reusable, and maintainable code following SOLID principles
• Developing comprehensive automated tests using frameworks such as pytest
• Experience with unit, integration, and end-to-end testing, including mocking
• Writing clear documentation and docstrings
• Effective exception handling and logging
• Understanding of python packaging, dependency management and virtual environments
• Ability to profile and optimise python code for performance
• Familiarity with common design patterns
• Experience building production data pipelines
• SQL expertise, ideally including snowflake or similar cloud data warehouse
• Git and collaborative software development
• Testing and validation frameworks
• Performance optimisation


Nice to have
• Experience with dbt
• Previous experience working with marketing rules engines
• Experience designing configurable business rules or workflow engines
• Experience with AWS
• Experience with prefect or similar orchestration tooling

What success looks like
By the end of the six-month project, you will have delivered:
• A functioning configurable decision engine for marketing selections
• A full suite of utilities to allow selection across a range of dimensions, using an easily extensible design pattern
• A full test suite for all utilities developed
• Snapshot testing results showing equivalent results to legacy decision engine
• Robust error handling for all pipelines
• User warnings for edge cases which violate business logic
• Runtime optimisation, yielding results in a practically performant time window
• Integration with the front-end (with assistance from Platform team