Skip to content

Commit fc3e6f9

Browse files
committed
feat: redesign README with premium header, author credits, pipeline teaser, and feature highlights
1 parent 8d42314 commit fc3e6f9

4 files changed

Lines changed: 337 additions & 12 deletions

File tree

README.md

Lines changed: 50 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,30 +1,68 @@
11
<div align="center">
22

3-
<img src="assets/icon.png" alt="QuantVLA Logo" width="160">
3+
<img src="assets/icon.png" alt="QuantVLA Logo" width="180">
4+
5+
<br>
46

57
# QuantVLA
68

7-
### Scale-Calibrated Post-Training Quantization for Vision-Language-Action Models
9+
**Scale-Calibrated Post-Training Quantization for Vision-Language-Action Models**
810

9-
[![CVPR 2026](https://img.shields.io/badge/CVPR-2026-6B46C1?style=for-the-badge&logo=ieee&logoColor=white)](https://cvpr.thecvf.com/Conferences/2026)
11+
<a href="https://cvpr.thecvf.com/Conferences/2026"><img src="https://img.shields.io/badge/CVPR-2026-6B46C1?style=for-the-badge&logo=ieee&logoColor=white" alt="CVPR 2026"></a>
1012

11-
[![Paper](https://img.shields.io/badge/Paper-PDF-d32f2f?style=flat-square&logo=adobeacrobatreader&logoColor=white)](https://arxiv.org/pdf/2602.20309)
12-
[![arXiv](https://img.shields.io/badge/arXiv-2602.20309-b31b1b?style=flat-square&logo=arxiv&logoColor=white)](https://arxiv.org/abs/2602.20309)
13-
[![Project Page](https://img.shields.io/badge/Project-Page-7c4dff?style=flat-square&logo=googlechrome&logoColor=white)](https://quantvla.github.io/)
14-
[![Code](https://img.shields.io/badge/GitHub-Code-181717?style=flat-square&logo=github&logoColor=white)](https://github.com/AIoT-MLSys-Lab/QuantVLA)
13+
<br>
1514

16-
---
15+
<a href="https://arxiv.org/pdf/2602.20309"><img src="https://img.shields.io/badge/📄_Paper-PDF-d32f2f?style=for-the-badge" alt="Paper"></a>
16+
<a href="https://arxiv.org/abs/2602.20309"><img src="https://img.shields.io/badge/📝_arXiv-2602.20309-b31b1b?style=for-the-badge" alt="arXiv"></a>
17+
<a href="https://quantvla.github.io/"><img src="https://img.shields.io/badge/🌐_Project-Page-7c4dff?style=for-the-badge" alt="Project Page"></a>
18+
<a href="https://github.com/AIoT-MLSys-Lab/QuantVLA"><img src="https://img.shields.io/badge/💻_GitHub-Code-181717?style=for-the-badge" alt="Code"></a>
19+
20+
<br>
21+
22+
[Jingxuan Zhang](https://github.com)<sup>2†</sup>&nbsp;&nbsp;
23+
[Yunta Hsieh](https://github.com)<sup>3†</sup>&nbsp;&nbsp;
24+
[Zhongwei Wan](https://github.com)<sup>1</sup>&nbsp;&nbsp;
25+
[Haokun Lin](https://github.com)<sup>4</sup>&nbsp;&nbsp;
26+
[Xin Wang](https://github.com)<sup>1</sup>&nbsp;&nbsp;
27+
[Ziqi Wang](https://github.com)<sup>1</sup>&nbsp;&nbsp;
28+
[Yingtie Lei](https://github.com)<sup>1</sup>&nbsp;&nbsp;
29+
[Mi Zhang](https://github.com)<sup>1*</sup>
30+
31+
<sup>1</sup>The Ohio State University&nbsp;&nbsp;<sup>2</sup>Indiana University&nbsp;&nbsp;<sup>3</sup>University of Michigan&nbsp;&nbsp;<sup>4</sup>City University of Hong Kong
32+
33+
<sup>†</sup>Equal Contribution&nbsp;&nbsp;&nbsp;<sup>*</sup>Corresponding Author
34+
35+
</div>
1736

18-
🏆 **First Post-Training Quantization for VLA Systems** &nbsp;|&nbsp; 💾 **~70% Memory Savings** &nbsp;|&nbsp;**Training-Free**
37+
<br>
1938

39+
<div align="center">
40+
41+
| 🏆 First PTQ for VLA | 💾 ~70% Memory Savings | ⚡ Training-Free | 🚀 1.22× Speedup |
42+
|:---:|:---:|:---:|:---:|
43+
| First post-training quantization framework for Vision-Language-Action systems | Significant memory reduction on quantized components | Uses only a small unlabeled calibration buffer — no retraining needed | End-to-end inference latency improvement |
44+
45+
</div>
46+
47+
<br>
48+
49+
<div align="center">
50+
<img src="assets/pipeline.svg" alt="QuantVLA Pipeline" width="100%">
51+
<br>
52+
<em>Overview of the QuantVLA framework: selective quantization layout + attention temperature matching + output head balancing.</em>
2053
</div>
2154

55+
<br>
56+
2257
## Abstract
2358

24-
Vision-language-action (VLA) models unify perception, language, and control for embodied agents but face significant challenges in practical deployment due to rapidly increasing compute and memory demands, especially as models scale to longer horizons and larger backbones. To address these bottlenecks, we introduce **QuantVLA**, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to successfully quantize a diffusion transformer (DiT) action head. QuantVLA incorporates three scale-calibrated components: (1) a selective quantization layout that integerizes all linear layers in both the language backbone and the DiT while keeping attention projections in floating point to preserve the original operator schedule; (2) attention temperature matching, a lightweight per-head scaling mechanism that stabilizes attention logits and is folded into the dequantization scales at inference; and (3) output head balancing, a per-layer residual interface calibration that mitigates post-projection energy drift. The framework requires no additional training, uses only a small unlabeled calibration buffer, and supports integer kernels for low-bit weights and activations while leaving the architecture unchanged. Across representative VLA models on LIBERO, QuantVLA exceeds the task success rates of full-precision baselines, achieves about **70% relative memory savings** on the quantized components, providing a practical pathway toward scalable low-bit embodied intelligence under strict compute, memory, and power constraints.
59+
Vision-language-action (VLA) models unify perception, language, and control for embodied agents but face significant challenges in practical deployment due to rapidly increasing compute and memory demands, especially as models scale to longer horizons and larger backbones. To address these bottlenecks, we introduce **QuantVLA**, a training-free post-training quantization (PTQ) framework that, to our knowledge, is the first PTQ approach for VLA systems and the first to successfully quantize a diffusion transformer (DiT) action head. QuantVLA incorporates three scale-calibrated components: (1) a selective quantization layout that integerizes all linear layers in both the language backbone and the DiT while keeping attention projections in floating point to preserve the original operator schedule; (2) attention temperature matching, a lightweight per-head scaling mechanism that stabilizes attention logits and is folded into the dequantization scales at inference; and (3) output head balancing, a per-layer residual interface calibration that mitigates post-projection energy drift. The framework requires no additional training, uses only a small unlabeled calibration buffer, and supports integer kernels for low-bit weights and activations while leaving the architecture unchanged. Across representative VLA models on LIBERO, QuantVLA exceeds the task success rates of full-precision baselines, achieves about **70% relative memory savings** on the quantized components, and delivers a **1.22× speedup** in end-to-end inference latency, providing a practical pathway toward scalable low-bit embodied intelligence under strict compute, memory, and power constraints.
2560

26-
- 📄 Paper: https://arxiv.org/abs/2602.20309
27-
- 🌐 Project page: https://quantvla.github.io/
61+
<p align="center">
62+
📄 <a href="https://arxiv.org/abs/2602.20309">Paper</a> &nbsp;|&nbsp;
63+
🌐 <a href="https://quantvla.github.io/">Project Page</a> &nbsp;|&nbsp;
64+
💻 <a href="https://github.com/AIoT-MLSys-Lab/QuantVLA">Code</a>
65+
</p>
2866

2967

3068
# QuantVLA GR00T Environment Setup Guide

assets/comparison.png

170 KB
Loading

assets/memory_comparison.png

83 KB
Loading

assets/pipeline.svg

Lines changed: 287 additions & 0 deletions
Loading

0 commit comments

Comments
 (0)