v0.9.0: early opus 4.7 support; major Paper Reader overhaul (beta); Amazon Bedrock endpoint; SQLite fallback (no PostgreSQL required); numerous bug fixes

Author: rangehow

.github/workflows/ci.yml

@@ -89,28 +89,7 @@ jobs:
     needs: lint
     timeout-minutes: 15
 
-    services:
-      postgres:
-        image: postgres:17
-        env:
-          POSTGRES_USER: chatui
-          POSTGRES_PASSWORD: chatui
-          POSTGRES_DB: chatui
-        ports:
-          - 5432:5432
-        options: >-
-          --health-cmd "pg_isready -U chatui"
-          --health-interval 10s
-          --health-timeout 5s
-          --health-retries 5
-
-    env:
-      CHATUI_PG_HOST: localhost
-      CHATUI_PG_PORT: "5432"
-      CHATUI_PG_USER: chatui
-      CHATUI_PG_PASSWORD: chatui
-      CHATUI_PG_DBNAME: chatui
-
+    # No service containers needed — SQLite is built into Python
     steps:
       - uses: actions/checkout@v4
 
@@ -150,5 +129,3 @@ jobs:
 
       - name: Run healthcheck
         run: python healthcheck.py
-
-

.gitignore

@@ -23,6 +23,9 @@ data/
 /sundries/
 /tools/
 
+# ── SWE-bench workdir (large, causes FUSE timeouts) ──
+swebench_workdir/
+
 # ── Test coverage ──
 .coverage
 
@@ -61,3 +64,4 @@ docs/RATE_LIMITING_DOS_AUDIT_REPORT.md
 # ── Uploads ──
 uploads/images/*
 !uploads/images/.gitkeep
+uploads/pptx/

Dockerfile

@@ -13,9 +13,6 @@ FROM python:3.12-slim AS base
 
 # ── System dependencies ─────────────────────────────────────
 RUN apt-get update && apt-get install -y --no-install-recommends \
-        # PostgreSQL (Debian bookworm ships v16 — compatible with PG 18+ protocol)
-        postgresql-16 \
-        postgresql-client-16 \
         # Build tools for compiled Python packages
         gcc g++ \
         # Playwright / browser automation system deps
@@ -49,18 +46,16 @@ RUN mkdir -p /app/data /app/logs /app/uploads
 # ── Environment defaults ───────────────────────────────────
 ENV PORT=15000 \
     BIND_HOST=0.0.0.0 \
-    # PostgreSQL runs as a local subprocess managed by the app
-    # Data lives in the mounted volume at /app/data
     PYTHONUNBUFFERED=1 \
     PYTHONDONTWRITEBYTECODE=1
 
 # ── Expose port ────────────────────────────────────────────
 EXPOSE 15000
 
 # ── Health check ───────────────────────────────────────────
-HEALTHCHECK --interval=30s --timeout=5s --start-period=30s --retries=3 \
+HEALTHCHECK --interval=30s --timeout=5s --start-period=10s --retries=3 \
     CMD curl -f http://localhost:15000/ || exit 1
 
 # ── Entrypoint ─────────────────────────────────────────────
-# server.py auto-bootstraps PostgreSQL on first run
+# SQLite auto-creates the database on first run — zero setup needed
 CMD ["python", "server.py"]

README.md

@@ -7,7 +7,8 @@
 <p align="center">
   <a href="https://github.com/rangehow/ToFu/actions/workflows/ci.yml"><img src="https://github.com/rangehow/ToFu/actions/workflows/ci.yml/badge.svg" alt="CI"></a>
   <img src="https://img.shields.io/badge/python-3.10+-3776ab?logo=python&logoColor=white" alt="Python" />
-  <img src="https://img.shields.io/badge/PostgreSQL-18+-336791?logo=postgresql&logoColor=white" alt="PostgreSQL" />
+  <img src="https://img.shields.io/badge/SQLite-3-003B57?logo=sqlite&logoColor=white" alt="SQLite" />
+  <img src="https://img.shields.io/badge/PostgreSQL-18+ (optional)-336791?logo=postgresql&logoColor=white" alt="PostgreSQL optional" />
   <img src="https://img.shields.io/badge/license-MIT-green" alt="License" />
   <img src="https://img.shields.io/badge/platform-Linux%20·%20macOS%20·%20Windows-lightgrey" alt="Platform" />
 </p>
@@ -50,7 +51,9 @@ git clone https://github.com/rangehow/ToFu.git && cd ToFu
 python install.py
 ```
 
-This creates a virtual environment, installs dependencies, bootstraps PostgreSQL, and starts the server. Open **http://localhost:15000** when it's ready.
+This creates a virtual environment, installs dependencies, and starts the server. Open **http://localhost:15000** when it's ready.
+
+> 💾 **Database: zero-config out of the box.** Tofu uses **SQLite** by default — it's built into Python, no install needed. If PostgreSQL is available it will auto-bootstrap and upgrade to PG (better concurrency for 100+ users). Force SQLite with `CHATUI_DB_BACKEND=sqlite`.
 
 ```bash
 # Pre-configure API key and port
@@ -75,15 +78,29 @@ Open **http://localhost:15000** — done. All data persists in Docker volumes.
 <details>
 <summary><strong>Manual Install</strong> (for full control)</summary>
 
-**Prerequisites:** Python 3.10+, PostgreSQL 18+, ripgrep & fd-find (recommended)
+**Prerequisites:** Python 3.10+, ripgrep & fd-find (recommended). PostgreSQL 18+ is *optional* — Tofu uses SQLite by default.
+
+> 💡 **Strongly recommended: use [Miniforge](https://github.com/conda-forge/miniforge) to manage your Python environment.**
+> Old system-installed conda/Anaconda versions often cause dependency conflicts. Install the latest Miniforge for a clean, up-to-date conda-forge environment:
+> ```bash
+> # Download and install Miniforge (Linux x86_64 example)
+> wget -O /tmp/Miniforge3.sh "https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh"
+> bash /tmp/Miniforge3.sh -b -p ~/miniforge3
+> ~/miniforge3/bin/conda init bash && source ~/.bashrc
+>
+> # Create a dedicated environment
+> conda create -n tofu python=3.10 -y
+> conda activate tofu
+> ```
+> For other platforms, see the [Miniforge releases page](https://github.com/conda-forge/miniforge/releases).
 
 ```bash
 git clone https://github.com/rangehow/ToFu.git && cd ToFu
 
-# Create environment
+# Create environment (skip if using conda/Miniforge)
 python -m venv .venv && source .venv/bin/activate
 
-# Install PostgreSQL (if not already)
+# Optional: install PostgreSQL for better concurrency (SQLite works out of the box)
 # macOS:   brew install postgresql@18
 # Ubuntu:  sudo apt install postgresql
 # conda:   conda install -c conda-forge postgresql>=18
@@ -104,7 +121,7 @@ python server.py
 
 </details>
 
-> **PostgreSQL** runs as a local userspace process — no `sudo`, no system service. On first launch, the database auto-bootstraps (initdb, schema creation, port selection).
+> **Database auto-detection:** On first launch, Tofu tries PostgreSQL first (for best concurrency). If PG isn't available, it falls back to **SQLite** automatically — no action needed on your part. PostgreSQL runs as a local userspace process when present (no `sudo`, no system service). Set `CHATUI_DB_BACKEND=sqlite` to force SQLite.
 
 > **Missing packages?** If any dependency is missing, `server.py` auto-delegates to `bootstrap.py`, which uses the LLM to diagnose the error and `pip install` the right packages — even when *every* pip package is missing.
 
@@ -120,7 +137,7 @@ Click **⚙️ Settings → 🔗 Providers** and add your API keys. Tofu works w
 
 | Provider | Setup |
 |---|---|
-| OpenAI, Anthropic, Google Gemini, DeepSeek, Qwen, MiniMax, GLM, Doubao, Mistral, Grok, Baidu Qianfan, OpenRouter | Click **⚡ Add from template** — one click |
+| OpenAI, Anthropic, Amazon Bedrock, Google Gemini, DeepSeek, Qwen, MiniMax, GLM, Doubao, Mistral, Grok, Baidu Qianfan, OpenRouter | Click **⚡ Add from template** — one click |
 | Ollama, vLLM, or any local model server | Add as custom provider with your local endpoint |
 | Azure OpenAI | Template available with deployment-specific base URL |
 
@@ -348,6 +365,22 @@ The agent connects to your Tofu server and exposes tools for file operations, cl
 
 ---
 
+### 📄 Paper Reader (beta)
+
+When you're reading research papers — arXiv PDFs, conference proceedings, internal whitepapers — Paper Reader turns Tofu into a dedicated research companion.
+
+**How to use:** Click the **📄 Paper** button in the sidebar. The screen splits: **PDF on the left**, **chat + notes on the right**. Upload a PDF or paste an arXiv URL (`arxiv.org/abs/XXXX.XXXXX`) — Tofu fetches, parses, and indexes the full text so the assistant can answer questions grounded in the paper.
+
+**What it does:**
+- **Grounded Q&A** — ask "what's the ablation result in Table 3?" or "explain Section 4.2" — the assistant cites the specific passage it's drawing from
+- **Paper library** — the left sidebar shows all papers you've read, grouped by date; switch between them without losing conversation context
+- **Side-by-side reading** — scroll the PDF while chatting; the assistant sees the page you're on
+- **Notes tab** — drop your own notes alongside the paper; they persist across sessions
+
+> ⚠️ **Beta:** Paper Reader is actively being iterated on. Feedback welcome on [GitHub Issues](https://github.com/rangehow/ToFu/issues).
+
+---
+
 ### 🖼️ Image Generation
 
 When you need visual content — illustrations, diagrams, logos, edited photos — the assistant can generate images mid-conversation.
@@ -501,7 +534,7 @@ The `.env.example` file documents all supported variables. Key ones:
 │   ├── agent_backends/        CLI backend switching (builtin/Claude Code/Codex)
 │   ├── llm_client.py          LLM API client (streaming, retry)
 │   ├── llm_dispatch/          Multi-key multi-model smart dispatcher
-│   ├── database/              PostgreSQL (auto-bootstrap, migrations)
+│   ├── database/              Dual backend — SQLite default, PostgreSQL auto-bootstrap
 │   ├── tasks_pkg/             Task orchestration & context compaction
 │   │   ├── orchestrator.py    Main LLM ↔ tool loop
 │   │   ├── executor.py        Tool execution engine
@@ -536,7 +569,8 @@ The `.env.example` file documents all supported variables. Key ones:
 | Feature | Linux | macOS | Windows |
 |---|:---:|:---:|:---:|
 | Core chat & tools | ✅ | ✅ | ✅ |
-| PostgreSQL auto-bootstrap | ✅ | ✅ | ✅ |
+| SQLite (default, zero-config) | ✅ | ✅ | ✅ |
+| PostgreSQL auto-bootstrap (optional) | ✅ | ✅ | ✅ |
 | Project co-pilot | ✅ | ✅ | ✅ |
 | Shell commands | ✅ | ✅ | ✅ (`cmd.exe`) |
 | Desktop agent | ✅ | ✅ | ✅ |

README_CN.md

@@ -7,7 +7,8 @@
 <p align="center">
   <a href="https://github.com/rangehow/ToFu/actions/workflows/ci.yml"><img src="https://github.com/rangehow/ToFu/actions/workflows/ci.yml/badge.svg" alt="CI"></a>
   <img src="https://img.shields.io/badge/python-3.10+-3776ab?logo=python&logoColor=white" alt="Python" />
-  <img src="https://img.shields.io/badge/PostgreSQL-18+-336791?logo=postgresql&logoColor=white" alt="PostgreSQL" />
+  <img src="https://img.shields.io/badge/SQLite-3-003B57?logo=sqlite&logoColor=white" alt="SQLite" />
+  <img src="https://img.shields.io/badge/PostgreSQL-18+ (可选)-336791?logo=postgresql&logoColor=white" alt="PostgreSQL 可选" />
   <img src="https://img.shields.io/badge/license-MIT-green" alt="License" />
   <img src="https://img.shields.io/badge/platform-Linux%20·%20macOS%20·%20Windows-lightgrey" alt="Platform" />
 </p>
@@ -50,7 +51,9 @@ git clone https://github.com/rangehow/ToFu.git && cd ToFu
 python install.py
 ```
 
-安装脚本会自动创建虚拟环境、安装依赖、初始化 PostgreSQL 并启动服务器。就绪后打开 **http://localhost:15000**。
+安装脚本会自动创建虚拟环境、安装依赖并启动服务器。就绪后打开 **http://localhost:15000**。
+
+> 💾 **数据库：开箱即用、无需配置。** Tofu 默认使用 **SQLite** —— Python 内置，无需安装。如果系统中有 PostgreSQL，Tofu 会自动初始化并升级为 PG 后端（支持 100+ 用户更高并发）。设置 `CHATUI_DB_BACKEND=sqlite` 即可强制使用 SQLite。
 
 ```bash
 # 预配置 API 密钥和端口
@@ -75,15 +78,29 @@ docker compose up -d
 <details>
 <summary><strong>手动安装</strong>（完全控制）</summary>
 
-**前提条件：** Python 3.10+，PostgreSQL 18+，ripgrep & fd-find（推荐）
+**前提条件：** Python 3.10+，ripgrep & fd-find（推荐）。PostgreSQL 18+ 为*可选* —— Tofu 默认使用 SQLite。
+
+> 💡 **强烈推荐：使用 [Miniforge](https://github.com/conda-forge/miniforge) 管理 Python 环境。**
+> 旧版系统自带的 conda/Anaconda 经常导致依赖冲突。安装最新版 Miniforge 可获得干净、最新的 conda-forge 环境：
+> ```bash
+> # 下载并安装 Miniforge（Linux x86_64 示例）
+> wget -O /tmp/Miniforge3.sh "https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh"
+> bash /tmp/Miniforge3.sh -b -p ~/miniforge3
+> ~/miniforge3/bin/conda init bash && source ~/.bashrc
+>
+> # 创建专用环境
+> conda create -n tofu python=3.10 -y
+> conda activate tofu
+> ```
+> 其他平台请参考 [Miniforge 发布页面](https://github.com/conda-forge/miniforge/releases)。
 
 ```bash
 git clone https://github.com/rangehow/ToFu.git && cd ToFu
 
-# 创建环境
+# 创建环境（如果已用 conda/Miniforge 则跳过此步）
 python -m venv .venv && source .venv/bin/activate
 
-# 安装 PostgreSQL（如尚未安装）
+# 可选：安装 PostgreSQL 以获得更高并发（SQLite 开箱即用）
 # macOS:   brew install postgresql@18
 # Ubuntu:  sudo apt install postgresql
 # conda:   conda install -c conda-forge postgresql>=18
@@ -104,7 +121,7 @@ python server.py
 
 </details>
 
-> **PostgreSQL** 以本地用户态进程运行 —— 无需 `sudo`，无需系统服务。首次启动时数据库自动初始化（initdb、建表、端口选择）。
+> **数据库自动检测：**首次启动时，Tofu 优先尝试 PostgreSQL（更好的并发性）；如 PG 不可用则自动回退到 **SQLite** —— 你无需任何操作。PostgreSQL 如存在会以本地用户态进程运行（无需 `sudo`，无需系统服务）。设置 `CHATUI_DB_BACKEND=sqlite` 即可强制使用 SQLite。
 
 > **缺少依赖？** 如果有任何 pip 包缺失，`server.py` 会自动委托给 `bootstrap.py`，通过 LLM 诊断错误并自动 `pip install` 所需的包 —— 即使*所有*依赖都缺失也能工作。
 
@@ -120,7 +137,7 @@ python server.py
 
 | 服务商 | 配置方式 |
 |---|---|
-| OpenAI、Anthropic、Google Gemini、DeepSeek、Qwen、MiniMax、GLM、Doubao、Mistral、Grok、百度千帆、OpenRouter | 点击 **⚡ 从模板添加** —— 一键完成 |
+| OpenAI、Anthropic、Amazon Bedrock、Google Gemini、DeepSeek、Qwen、MiniMax、GLM、Doubao、Mistral、Grok、百度千帆、OpenRouter | 点击 **⚡ 从模板添加** —— 一键完成 |
 | Ollama、vLLM 或任何本地模型服务 | 添加为自定义服务商，填入你的本地端点 |
 | Azure OpenAI | 模板可用，填入部署专属的 Base URL |
 
@@ -348,6 +365,22 @@ python lib/desktop_agent.py --server http://your-server:15000 --allow-write --al
 
 ---
 
+### 📄 论文阅读模式（Beta）
+
+阅读科研论文 —— arXiv PDF、会议论文集、内部白皮书 —— Paper Reader 把 Tofu 变成一个専用的科研阅读伙伴。
+
+**使用方法：** 点击侧边栏的 **📄 Paper** 按钮。页面分屏：**左侧 PDF、右侧对话 + 笔记**。上传 PDF 或粘贴 arXiv 链接（`arxiv.org/abs/XXXX.XXXXX`） —— Tofu 会抓取、解析、索引全文，令助手能基于论文内容精准回答。
+
+**能做什么：**
+- **有据可依的问答** —— “表 3 的消融实验结果是什么？”或“解释 4.2 节”，助手会引用具体段落
+- **论文库** —— 左侧侧边栏展示你读过的所有论文，按时间分组；切换论文不丢失上下文
+- **并排阅读** —— 滚动 PDF 的同时聊天；助手可感知你当前所在页面
+- **笔记面板** —— 在论文旁边记录你自己的笔记，跨会话持久保存
+
+> ⚠️ **Beta：** 论文阅读模式正在持续迭代中，欢迎在 [GitHub Issues](https://github.com/rangehow/ToFu/issues) 反馈。
+
+---
+
 ### 🖼️ 图片生成
 
 当你需要视觉内容 —— 插图、图表、Logo、修图 —— 助手可以在对话中直接生成图片。
@@ -501,7 +534,7 @@ vim .env   # 填入你的值
 │   ├── agent_backends/        CLI 后端切换（内置/Claude Code/Codex）
 │   ├── llm_client.py          LLM API 客户端（流式，重试）
 │   ├── llm_dispatch/          多密钥多模型智能调度器
-│   ├── database/              PostgreSQL（自动初始化，迁移）
+│   ├── database/              双后端—— SQLite 默认，PostgreSQL 自动初始化
 │   ├── tasks_pkg/             任务编排与上下文压缩
 │   │   ├── orchestrator.py    LLM ↔ 工具主循环
 │   │   ├── executor.py        工具执行引擎
@@ -536,7 +569,8 @@ vim .env   # 填入你的值
 | 功能 | Linux | macOS | Windows |
 |---|:---:|:---:|:---:|
 | 核心对话与工具 | ✅ | ✅ | ✅ |
-| PostgreSQL 自动初始化 | ✅ | ✅ | ✅ |
+| SQLite（默认，零配置） | ✅ | ✅ | ✅ |
+| PostgreSQL 自动初始化（可选） | ✅ | ✅ | ✅ |
 | 项目协作 | ✅ | ✅ | ✅ |
 | Shell 命令 | ✅ | ✅ | ✅ (`cmd.exe`) |
 | 桌面代理 | ✅ | ✅ | ✅ |

VERSION

@@ -1 +1 @@
-0.8.0
+0.9.0