BPS SE Scrapper
- Client
- Badan Pusat Statistik
- Year
- 2026
- Category
- Public Sector
- Status
- Archived
- Stack
- Chrome Extension, React, TypeScript, Next.js, SQLite, DuckDB WASM
A merchant data collection tool for Badan Pusat Statistik's Sensus Ekonomi (Economic Census) 2026. It has a Chrome extension that collects data from six e-commerce platforms and a Next.js web dashboard to store, map, and analyze the results.
№ 01 / The Challenge
The Challenge
The Economic Census needs to record businesses that sell through e-commerce platforms. Merchant data is spread across several platforms, each with different page structures and location filters, so manual recording is slow, error-prone, and hard to align with the BPS regional hierarchy.
№ 02 / What We Built
What We Built
Banua Coder built a Chrome extension that collects merchant data from Tokopedia, Shopee, GrabFood, GoFood, Lazada, and Blibli by BPS region (province, regency/city, district). Results can be exported to Excel, CSV, and JSON, or sent through an API to a Next.js web dashboard that provides a regency/city-level choropleth map and an in-browser SQL query editor.
№ 03 / Impact & Results
Impact & Results
- 01 Merchant data from six platforms collected with a single tool
- 02 Region selection follows the BPS hierarchy, so results are ready to match against census data
- 03 Results can be exported to Excel, CSV, and JSON or sent straight to the dashboard
- 04 Analysis in the dashboard without extra tooling, with a choropleth map and SQL queries that run in the browser
№ 04 / Project detail
Context
BPS SE Scrapper was built to support Badan Pusat Statistik’s Sensus Ekonomi (Economic Census) 2026. The Economic Census is a program BPS runs periodically to capture economic activity across Indonesia. One of its needs is to record merchants that sell on e-commerce platforms, whose data is spread across many platforms with different structures.
The project sits closer to data engineering than to typical application development. The priorities were tool reliability, data accuracy, and how easily results can be traced.
What We Built
The tool has an extension and a dashboard:
- Chrome extension: Runs in the browser and collects merchant data from Tokopedia, Shopee, GrabFood, GoFood, Lazada, and Blibli. Each platform has its own collector because each exposes its data differently. Regions are selected following the BPS hierarchy, from province down to district. Results can be downloaded as Excel, CSV, or JSON, or sent to the dashboard through an API.
- Web dashboard: A Next.js application with user authentication, SQLite and Parquet storage, a regency/city-level choropleth map, and a DuckDB WASM SQL query editor for analysis directly in the browser.
Impact
Merchant data from six platforms is collected with one tool, then mapped and analyzed in the dashboard without recording each merchant by hand. The project is now archived.
Tech Stack
- Chrome Extension
- React
- TypeScript
- Next.js
- SQLite
- DuckDB WASM
Start a project
Need something like this?
Tell us about your product or system. We reply with scope, timeline and a realistic estimate.