# ViCoupon Product & Price Crawler

> Java crawler system that collects product data and tracks prices across e-commerce platforms worldwide, powering deals and coupons on ViCoupon.com.

- Role: Creator
- Period: 2024 – now
- Type: Open source
- Status: shipped
- Stack: Java 21, Jsoup, Selenium, MySQL / MongoDB, AWS
- Website: https://vicoupon.com
- Source: https://github.com/kanephamphu/vi-product-spider
- URL: https://phamphutai.com/projects/vicoupon-crawler/

## What it does

Collects product names, prices, descriptions and availability from e-commerce stores, then tracks price changes over time so ViCoupon users see the best current deals.

## How it works

1. **Crawl:** a crawler per store extracts product details. Jsoup handles static pages and headless Selenium handles JavaScript-heavy ones.
2. **Process:** data is cleaned and normalized.
3. **Store & export:** saved to MySQL or MongoDB, and exported as CSV or JSON for analytics and the website.

Crawl frequency, stores and product filters are configurable, and it is designed to scale out on AWS.