日本語のREADMEはこちらです: README.ja.md
This repository contains the automated data processing pipeline for the Ishikawa Prefecture tourism survey. It fetches raw data from Google Sheets, cleans it, and publishes it as open data CSV files.
The processed survey data is available for three regions and as a combined dataset.
- All Data: all.csv
- Kanazawa Area: kanazawa.csv
- Kaga Area: kaga.csv
- Noto Area: noto.csv
A GitHub Actions workflow runs daily at 17:25 UTC to automatically update the datasets.
- Fetch Data: The
download.jsscript fetches the latest survey responses as CSV files from public Google Sheets URLs defined inlist.js. - Process & Clean: The
make.jsscript then processes the raw data:- It combines data from all three regions (Kanazawa, Kaga, Noto).
- It maps the long, descriptive Japanese column headers to shorter, standardized field names.
- It filters out any responses where the user did not consent to the privacy policy.
- It sorts the data by timestamp and assigns a unique ID to each entry.
- Publish: The final, cleaned CSV files (
all.csv,kanazawa.csv, etc.) are committed back to the repository and published via GitHub Pages.
The final all.csv file contains the following columns:
ID: Unique identifier for each response回答エリア: Response area (金沢, 加賀, 能登)回答日時: Timestamp of the response宿泊数(全行程): Number of nights stayed (entire trip)宿泊数(県内): Number of nights stayed (in Ishikawa)宿泊エリア(県内): Accommodation area (in Ishikawa)宿泊エリア(県外): Accommodation area (outside Ishikawa)同行者: Travel companions宿泊目的: Purpose of visit交通手段: Means of transportation to Ishikawa交通手段(施設): Means of transportation to the facility満足度(交通手段): Satisfaction with transportation満足度理由(交通手段): Reason for transportation satisfaction一人あたり宿泊費: Accommodation cost per person一人あたり交通費: Transportation cost per person一人あたり消費額(県内): Spending per person (in Ishikawa, excluding accommodation/transport)訪問回数: Number of previous visits to the facility情報源: Information source for the visit訪問施設(前): Previous place visited訪問施設(前)自由記入: Previous place visited (free text)訪問施設(後)自由記入: Next place to visit (free text)一人あたり消費額(施設): Spending per person (at the facility)満足度(商品・サービス): Satisfaction with products/services満足度理由(商品・サービス): Reason for product/service satisfaction満足度(施設): Satisfaction with the facility満足度理由(施設): Reason for facility satisfaction不便(施設): Inconveniences at the facility不便理由: Reason for inconvenienceNPS: Net Promoter Score (0-10)推薦理由: Reason for recommendation自由意見(施設): Free comments (about the facility)リピート意向: Intention to revisit Ishikawa自由意見(県内): Free comments (about Ishikawa)性別: Gender生年: Birth year都道府県: Prefecture of residence市区町村: Municipality of residence世帯年収: Household income回答動機: Motivation for answering the survey
To run the data processing pipeline manually, you need the Deno runtime.
- Clone the repository:
git clone https://github.com/code4fukui/ishikawa-kanko-survey.git cd ishikawa-kanko-survey - Download the latest raw data from Google Sheets:
deno run -A download.js
- Process the raw data to generate the final CSV files:
deno run -A make.js
The open data is provided by the Ishikawa Prefecture Tourism Strategy Promotion Division, Tourism Planning Division.