GB-Scraper
May 2023 — Jun 2023Search-aggregation platform that scrapes Google and Bing in parallel and streams progress live.
- Engineered a search-aggregation platform scraping Google and Bing results with Puppeteer, streaming live progress over Socket.IO.
- Secured the service with JWT authentication, password hashing, CSRF protection, and query rate limiting, capping load under concurrent scraping jobs.
- Next.js
- Node.js
- Express.js
- MongoDB
- Socket.IO
- Puppeteer