Skip to content

Commit a61c709

Browse files
committed
add dashboard
1 parent e93bab3 commit a61c709

53 files changed

Lines changed: 10099 additions & 0 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,3 +29,29 @@ tests/onecomp/quantizer/jointq/data/model_layers_0_self_attn_k_proj.pth
2929
.uv-sync-vllm.lock
3030
.uv-sync-vllm.done
3131
.venv-vllm/
32+
33+
# ── dashboard/ (HPC LLM quantization dashboard) ──────────────
34+
# Re-include the app/models package shadowed by the global `models` rule above
35+
!dashboard/backend/app/models/
36+
!dashboard/backend/app/models/*.py
37+
38+
# uv venv (.venv-vllm/ already covered above)
39+
dashboard/backend/.venv/
40+
41+
# Redis built from source per dashboard/docs/setup-hpc.md §1.3
42+
dashboard/backend/7.2.7.tar.gz
43+
dashboard/backend/redis-*/
44+
dashboard/backend/dump.rdb
45+
46+
# Runtime state (SQLite, quantized models)
47+
dashboard/backend/onecomp.db
48+
dashboard/backend/onecomp.db-journal
49+
dashboard/backend/tmp/
50+
51+
# Frontend (node_modules already in dashboard/frontend/.gitignore; dist/ covered by global rule)
52+
dashboard/frontend/node_modules/
53+
# yarn is canonical (README uses `yarn dev`); avoid double lockfiles
54+
dashboard/frontend/package-lock.json
55+
56+
# vLLM / worker logs written under /tmp by setup-hpc.md
57+
*.log

CHANGELOG.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,12 @@
22

33
## [v1.2.0] 2026-06-04 (WIP)
44

5+
## New Feature : Dashboard
6+
7+
- Added `dashboard/`, a browser-based web app for OneCompression on **SLURM-managed HPC GPU nodes without Docker**: pick a Hugging Face model and quantization settings in the UI, run jobs on the GPU, deploy the quantized checkpoint, and validate inference via chat
8+
- **Stack**: React + Vite frontend (local PC), FastAPI API, Celery worker + user-built Redis, SQLite job DB, per-job output under `backend/tmp/quantized/`; CUDA quantization via `onecomp` and chat deploy via a separate **vLLM** subprocess from the same `backend/.venv` (`onecomp` + `vllm>=0.21` in `pyproject.toml`)
9+
- **Quantization methods exposed in the UI**: `gptq`, `autobit`, `jointq`, and `auto_run` (VRAM-based bitwidth / group size); optional QEP (not with JointQ); fractional bit widths for `autobit` / `auto_run`
10+
511
### for Developer: pre-commit
612

713
- Added `.pre-commit-config.yaml` with `black`, `isort`, and local hooks (`no-japanese`, `copyright-header`, `no-email-address`); install with `uv sync --extra dev` then `pre-commit install` (see README)

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ Full documentation is available at **[https://FujitsuResearch.github.io/OneCompr
4141
- **Block-wise PTQ**: Post-quantization block-wise distillation that minimises intermediate-representation MSE against an FP16 teacher model at Transformer-block granularity. Includes Phase 1 (greedy per-block optimisation) and Phase 2 CBQ (cross-block sliding-window optimisation). Supports GPTQ, DBF, and OneBit quantizers.
4242
- **LoRA SFT Post-Process**: Fine-tune quantized models with LoRA adapters for accuracy recovery or domain-specific knowledge injection. Supports SFT loss, teacher distillation, and intermediate block alignment.
4343
- **Rotation Preprocessing**: SpinQuant/OstQuant-based rotation preprocessing that reduces quantization error by learning optimal rotation matrices before quantization. Rotation/scaling matrices are absorbed into model weights, with online Hadamard hooks automatically registered at load time. Supports Llama and Qwen3 architectures.
44+
- **Web Dashboard (HPC)**: A browser-based dashboard for launching quantization jobs, deploying models, and validating chat-based inference in HPC environments. See [dashboard/README.md](dashboard/README.md) for details.
4445
- (TBD)
4546

4647
## 🤖 Supported Models

0 commit comments

Comments
 (0)