What it does
Collects product names, prices, descriptions and availability from e-commerce stores, then tracks price changes over time so ViCoupon users see the best current deals.
How it works
- Crawl: a crawler per store extracts product details. Jsoup handles static pages and headless Selenium handles JavaScript-heavy ones.
- Process: data is cleaned and normalized.
- Store & export: saved to MySQL or MongoDB, and exported as CSV or JSON for analytics and the website.
Crawl frequency, stores and product filters are configurable, and it is designed to scale out on AWS.