feat(route/baidu): add BAIDU_COOKIE support and extract shared … by FlanChanXwO · Pull Request #21663 · DIYgod/RSSHub

FlanChanXwO · 2026-04-08T11:10:47Z

Involved Issue / 该 PR 相关 Issue

Close #19642

Example for the Proposed Route(s) / 路由地址示例

/baidu/tieba/forum/good/孙笑川
/baidu/tieba/post/10620724314
/baidu/tieba/user/斗鱼游戏君
/baidu/tieba/search/反原神

New RSS Route Checklist / 新 RSS 路由检查表

New Route / 新的路由
- Follows Script Standard / 跟随路由规范
Anti-bot or rate limit / 反爬/频率限制
- If yes, do your code reflect this sign? / 如果有, 是否有对应的措施?
Date and time / 日期和时间
- Parsed / 可以解析
- Correct time zone / 时区正确
New package added / 添加了新的包
Puppeteer

Note / 说明

概述

本次 PR 为百度贴吧的 4 个路由（/baidu/tieba/forum、/baidu/tieba/post、/baidu/tieba/search、/baidu/tieba/user）添加了 BAIDU_COOKIE 支持，以应对百度反爬机制的升级。

主要改动

从 HTTP 请求迁移到 Puppeteer
- 原有的路由使用 got/ofetch 直接发送 HTTP 请求获取页面内容
- 由于百度贴吧启用 JavaScript 渲染和反爬验证，原有方式已无法获取有效数据
- 现改为使用 Puppeteer 操控无头浏览器访问页面，可绕过反爬机制并正确获取 Vue 渲染的内容
新增 common.ts 共享模块
- parseBaiduCookies(): 正确解析包含 = 字符的 Cookie 值
- getTiebaPageContent(): 统一的页面获取逻辑，包含 Cookie 注入和安全验证检查
- normalizeUrl(): 将相对链接转换为绝对地址
- checkSecurityVerification(): 检测百度安全验证页面并抛出友好错误提示
各路由适配
- forum: 支持并发获取多页内容，自动去重，优化等待策略
- post: 保留富文本内容（链接、表情等），添加楼层信息，生成直达回复链接
- search: 规范搜索结果链接为绝对地址
- user: 适配新版用户主页结构，使用 .thread-card 选择器
改进时间解析
- parseRelativeTime() 支持更多格式（刚刚、昨天、X天前等）
- 添加日期有效性检查，避免输出 Invalid Date

必需配置

以下 4 个路由现在必须配置 BAIDU_COOKIE 才能使用：

路由	示例
`/baidu/tieba/forum/:kw`	`/baidu/tieba/forum/女图`
`/baidu/tieba/post/:id`	`/baidu/tieba/post/686961453`
`/baidu/tieba/search/:qw`	`/baidu/tieba/search/neuro`
`/baidu/tieba/user/:uid`	`/baidu/tieba/user/斗鱼游戏君`

配置方法

在环境变量或 .env 文件中设置：

BAIDU_COOKIE=BDUSS=your_bduss_value;other_cookie=value

…a routes and implement user post retrieval

… handling in forum, post, search, and user routes

… formatting - Refactor parseBaiduCookies function to use chained array methods for better readability - Simplify cookie parsing by trimming and filtering empty strings before mapping - Remove redundant comments in common.ts and post.tsx files - Improve code formatting by removing excessive blank lines - Maintain same functionality while enhancing code maintainability

…utilities Add common.ts for cookie parsing, page retrieval, security check and URL normalization. Refactor forum, post, search and user routes to use shared utilities. Preserve rich text content in post replies. Support direct reply links. Fix cookie value parsing for cookies containing '=' character. Route/baidu

- Remove trailing whitespace from empty lines - Ensure consistent line endings in utility functions

# Conflicts: # lib/routes/baidu/tieba/utils.ts

github-actions · 2026-04-08T11:15:56Z

Successfully generated as following:

http://localhost:1200/baidu/tieba/forum/good/孙笑川 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/forum/good/:kw/:cid?/:sortBy?
Full Route: /baidu/tieba/forum/good/孙笑川
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/post/10620724314 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/post/:id
Full Route: /baidu/tieba/post/10620724314
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/user/斗鱼游戏君 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/user/:uid
Full Route: /baidu/tieba/user/斗鱼游戏君
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/search/反原神 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/search/:qw/:routeParams?
Full Route: /baidu/tieba/search/反原神
Node Version: v24.14.1
Git Hash: 4e7e83d3

github-actions · 2026-04-08T11:26:48Z

Successfully generated as following:

http://localhost:1200/baidu/tieba/forum/good/孙笑川 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/forum/good/:kw/:cid?/:sortBy?
Full Route: /baidu/tieba/forum/good/孙笑川
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/post/10620724314 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/post/:id
Full Route: /baidu/tieba/post/10620724314
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/user/斗鱼游戏君 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/user/:uid
Full Route: /baidu/tieba/user/斗鱼游戏君
Node Version: v24.14.1
Git Hash: 4e7e83d3

http://localhost:1200/baidu/tieba/search/反原神 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/search/:qw/:routeParams?
Full Route: /baidu/tieba/search/反原神
Node Version: v24.14.1
Git Hash: 4e7e83d3

…ontent retrieval (#2)

github-actions · 2026-04-08T13:34:56Z

Successfully generated as following:

http://localhost:1200/baidu/tieba/forum/good/孙笑川 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/forum/good/:kw/:cid?/:sortBy?
Full Route: /baidu/tieba/forum/good/孙笑川
Node Version: v24.14.1
Git Hash: 9d3cb86d

http://localhost:1200/baidu/tieba/post/10620724314 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/post/:id
Full Route: /baidu/tieba/post/10620724314
Node Version: v24.14.1
Git Hash: 9d3cb86d

http://localhost:1200/baidu/tieba/user/斗鱼游戏君 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/user/:uid
Full Route: /baidu/tieba/user/斗鱼游戏君
Node Version: v24.14.1
Git Hash: 9d3cb86d

http://localhost:1200/baidu/tieba/search/反原神 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/search/:qw/:routeParams?
Full Route: /baidu/tieba/search/反原神
Node Version: v24.14.1
Git Hash: 9d3cb86d

github-actions · 2026-04-08T14:17:02Z

Successfully generated as following:

http://localhost:1200/baidu/tieba/forum/good/孙笑川 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/forum/good/:kw/:cid?/:sortBy?
Full Route: /baidu/tieba/forum/good/孙笑川
Node Version: v24.14.1
Git Hash: b2b46591

http://localhost:1200/baidu/tieba/post/10620724314 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/post/:id
Full Route: /baidu/tieba/post/10620724314
Node Version: v24.14.1
Git Hash: b2b46591

http://localhost:1200/baidu/tieba/user/斗鱼游戏君 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/user/:uid
Full Route: /baidu/tieba/user/斗鱼游戏君
Node Version: v24.14.1
Git Hash: b2b46591

http://localhost:1200/baidu/tieba/search/反原神 - Failed ❌

HTTPError: Response code 503 (Service Unavailable)

Error Message:<br/>ConfigNotFoundError: Baidu Tieba RSS is disabled due to the lack of &lt;a href=&quot;https://docs.rsshub.app/deploy/config#baidu&quot;&gt;BAIDU_COOKIE&lt;/a&gt;
Route: /baidu/tieba/search/:qw/:routeParams?
Full Route: /baidu/tieba/search/反原神
Node Version: v24.14.1
Git Hash: b2b46591

Copilot

Pull request overview

Adds BAIDU_COOKIE-driven Puppeteer fetching for Baidu Tieba routes to mitigate recent anti-bot/JS-rendering changes (closes #19642), and factors shared logic into a common module.

Changes:

Migrate Tieba forum/post/search/user routes from direct HTTP fetching to Puppeteer-based page rendering with cookie injection.
Introduce shared helpers (getTiebaPageContent, cookie parsing, URL normalization, security-verification detection) and thread/time parsing utilities.
Extend global config to support BAIDU_COOKIE and expose it via config.baidu.cookie.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
lib/routes/baidu/tieba/common.ts	New shared Puppeteer fetching + cookie parsing + verification detection + URL normalization.
lib/routes/baidu/tieba/utils.ts	New utilities for relative time parsing and thread list parsing across page variants.
lib/routes/baidu/tieba/forum.tsx	Switch forum routes to Puppeteer + shared parsing utilities; add BAIDU_COOKIE requirement.
lib/routes/baidu/tieba/post.tsx	Switch post route to Puppeteer and new selectors; add BAIDU_COOKIE requirement.
lib/routes/baidu/tieba/search.tsx	Switch search route to Puppeteer and new DOM selectors; normalize links; add BAIDU_COOKIE requirement.
lib/routes/baidu/tieba/user.tsx	Replace old user route implementation with Puppeteer-based version; add BAIDU_COOKIE requirement.
lib/routes/baidu/tieba/user.ts	Remove legacy got-based implementation.
lib/config.ts	Add `baidu.cookie` config plumbing and `BAIDU_COOKIE` env key.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

FlanChanXwO · 2026-04-22T13:09:05Z

Thank you for the detailed review! All feedback has been incorporated.

TonyRL · 2026-05-07T14:32:42Z

-        searchParams: params,
-    });
+    const pageUrl = `https://tieba.baidu.com/f?kw=${encodeURIComponent(kw)}&pn=0${cid === '0' ? '' : `&cid=${cid}`}${ctx.req.path.includes('good') ? '&tab=good' : ''}${sortParam}`;
+    const data = await getTiebaPageContent(pageUrl, `tieba:forum:${kw}:${cid}:${sortBy}`, { waitForSelector: '.thread-card-wrapper', timeout: 3000 });


Since browser rendering and cookie are now required, it would better to utility the API at /c/f/frs/page_pc instead of going for HTML.

FlanChanXwO and others added 8 commits April 8, 2026 17:36

feat(route/baidu): add support for BAIDU_COOKIE in various baidu tieb…

e9453f8

…a routes and implement user post retrieval

refactor(forum): improve code readability and structure in forum.tsx

7b880dd

feat(post): enhance time parsing and reply link generation in post.tsx

e083661

feat(route/baidu): refactor page content retrieval and enhance cookie…

e2d9a67

… handling in forum, post, search, and user routes

style(baidu/tieba): fix code formatting and whitespace issues

47415db

- Remove trailing whitespace from empty lines - Ensure consistent line endings in utility functions

Merge remote-tracking branch 'origin/master'

8b3a080

# Conflicts: # lib/routes/baidu/tieba/utils.ts

github-actions Bot added the route label Apr 8, 2026

github-actions Bot added auto: not ready to review Users can't get the RSS feed output according to automated testing results and removed auto: not ready to review Users can't get the RSS feed output according to automated testing results labels Apr 8, 2026

feat(route/baidu): add retry mechanism for transient errors in page c…

fc7ae10

…ontent retrieval (#2)

github-actions Bot added auto: not ready to review Users can't get the RSS feed output according to automated testing results and removed auto: not ready to review Users can't get the RSS feed output according to automated testing results labels Apr 8, 2026

Merge branch 'DIYgod:master' into master

e486eb3

github-actions Bot added auto: not ready to review Users can't get the RSS feed output according to automated testing results and removed auto: not ready to review Users can't get the RSS feed output according to automated testing results labels Apr 8, 2026

TonyRL reviewed Apr 14, 2026

View reviewed changes

fix: improve page content retrieval

bf19f34

Copilot AI review requested due to automatic review settings April 22, 2026 10:51

Copilot started reviewing on behalf of FlanChanXwO April 22, 2026 10:51 View session

style: auto format

cf78d1e

Copilot AI reviewed Apr 22, 2026

View reviewed changes

Comment thread lib/routes/baidu/tieba/user.tsx

Comment thread lib/routes/baidu/tieba/forum.tsx Outdated

Comment thread lib/routes/baidu/tieba/post.tsx

Comment thread lib/config.ts Outdated

Comment thread lib/routes/baidu/tieba/common.ts

Comment thread lib/routes/baidu/tieba/search.tsx Outdated

fix: improve URL encoding and enhance content retrieval logic

43322b7

TonyRL reviewed May 7, 2026

View reviewed changes

Conversation

FlanChanXwO commented Apr 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Involved Issue / 该 PR 相关 Issue

Example for the Proposed Route(s) / 路由地址示例

New RSS Route Checklist / 新 RSS 路由检查表

Note / 说明

概述

主要改动

必需配置

配置方法

Uh oh!

github-actions Bot commented Apr 8, 2026

Uh oh!

github-actions Bot commented Apr 8, 2026

Uh oh!

github-actions Bot commented Apr 8, 2026

Uh oh!

github-actions Bot commented Apr 8, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

FlanChanXwO commented Apr 22, 2026

Uh oh!

TonyRL May 7, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

FlanChanXwO commented Apr 8, 2026 •

edited

Loading