Overview
Full Time
Skills
Web Scraping
Internet
Software Development
Collaboration
Trading
Web Portals
Management
Computer Science
Data Engineering
Software Engineering
Cloud Computing
Amazon Web Services
Python
JavaScript
React.js
Artificial Intelligence
DevOps
Continuous Integration
Continuous Delivery
Job Details
Role Overview
The Webscraping team is seeking an experienced software engineer with broad full-stack experience and a passion for building internal applications, monitoring, and developer tools. As a center of expertise in web scraping, our team is responsible for distilling important data and signals from the internet and delivering it in a structured and accessible format, flexibly responding to the ever-changing needs of our investment teams and their strategies. We are looking for someone a track record of cross-disciplinary software development experience, who can help drive impactful improvements to our development process.
Responsibilities:
Minimum qualifications
Preferred qualifications
The Webscraping team is seeking an experienced software engineer with broad full-stack experience and a passion for building internal applications, monitoring, and developer tools. As a center of expertise in web scraping, our team is responsible for distilling important data and signals from the internet and delivering it in a structured and accessible format, flexibly responding to the ever-changing needs of our investment teams and their strategies. We are looking for someone a track record of cross-disciplinary software development experience, who can help drive impactful improvements to our development process.
Responsibilities:
- Collaborate as part of a globally distributed yet close-knit engineering team.
- Build trading-critical scraping pipelines, bringing data from raw source websites to our systems with low latency and high reliability
- Lead the development of our web portal (Next.js), where our team collaborates with our investment managers
- Build innovative developer-facing tooling to assist with the creation of scrapes and management of hotfixes
- Be a developer advocate, guiding the rollout of these tools to our team, and iterating on solutions
Minimum qualifications
- Degree in Computer Science or related field
- 3+ years of full stack experience
- 3+ years of experience in data engineering
- Strong knowledge of software engineering best practices.
- Familiarity with at least one cloud environment, preferably AWS.
- Self-starter who's not afraid to experiment, ask questions, and work through blockers.
- Experience in Python and Scrapy
Preferred qualifications
- Experience with Next.js or React
- Power user of AI-assisted coding tools
- Experience with DevOps techniques, including CI/CD and infrastructure-as-code
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.