A rapidly scaling data insights organization serving high-growth consumer markets is seeking a Data Integration Engineer to join its integrations and data acquisition team. This company ingests data from hundreds of external systems (APIs, web sources, SaaS platforms, and proprietary environments) to fuel real-time product, pricing, and marketplace intelligence used across the industry.
This role centers on building reliable connections between disparate digital ecosystems. You will own the full lifecycle of integrations, from web extraction to API orchestration to workflow automation, ensuring the organization can continuously expand and evolve its data network. If you thrive on untangling messy systems, automating complex processes, and enabling seamless data movement across platforms, this is a highly impactful role.
This is a full-time, hybrid position based in the Chicago Loop, with the opportunity to solve unique integration challenges in a fast-paced product environment. Required Skills & Experience
- 5+ years of experience in data integration, API development, web scraping, or workflow automation.
- Strong proficiency in Python for scripting, scraping, and custom integration logic.
- Hands-on experience with JavaScript (Puppeteer, Playwright, or similar tools) for browser-based scraping.
- Proven success building automations with low-code/no-code platforms (e.g., Zapier, n8n, Make, Apify workflows).
- Solid understanding of REST APIs, authentication protocols (OAuth2, API keys), JSON schemas, and webhooks.
- Experience working with relational databases and writing SQL for querying and data validation.
- Strong analytical and troubleshooting skills-you enjoy debugging edge cases, silent failures, and complex data flows.
- Ability to collaborate with internal engineering teams as well as external partners or system owners.
Desired Skills & Experience
- Experience developing Node.js services or browser extensions.
- Background integrating SaaS systems such as CRMs, e-commerce platforms, or marketing tools.
- Familiarity with high-volume scraping frameworks or professional-grade extraction environments.
- Exposure to AI-driven workflow enhancements or chat-based automation.
- Experience designing pipeline monitoring, observability, and error-handling frameworks.
- Ability to operate comfortably in environments where requirements shift and integrations evolve rapidly.
What You Will Be Doing Tech Breakdown:
- 50% designing and implementing integrations (APIs, scraping, automation)
- 30% workflow orchestration, monitoring, and optimization
- 20% collaboration, troubleshooting, and platform enablement
Daily Responsibilities:
- Build and maintain scalable web scraping agents using Python, JavaScript, and tools like Apify for structured extraction.
- Develop custom API integrations, create automation scripts, and extend LCNC platforms with Python-based logic.
- Construct multi-step workflows that connect external data sources to internal systems, product pipelines, and databases.
- Monitor and improve reliability of automations through logging, alerting, error handling, and performance tuning.
- Partner with product, data engineering, and customer-facing teams to support new data sources and integration needs.
- Evaluate new tools, platforms, and methodologies to expand integration capabilities and reduce manual data collection.
- Maintain documentation and ensure consistent data standards, schema expectations, and integration best practices.
The Offer You will receive the following benefits:
- Medical, dental, and vision coverage options
- Competitive salary
- Flexible work hours with a hybrid schedule in the Chicago Loop
- Opportunities for professional development, tooling experimentation, and technical growth
#LI-OP
Never miss an opportunity! Create an alert based on the job you applied for.