docs: consolidate rate-limit probe results into a proper benchmark report

The doc had been growing incrementally as each host got probed; reshape
it as a polished benchmark with TL;DR top, methodology section
(including safety constraints + caveats), per-host detailed tables,
final crawler settings, batch-50 walltime breakdown, and a reproduce
recipe.

Five hosts fully covered:
  pro.lceda.cn API   5.0s -> 0.5s  (10×)
  lceda.cn doc       5.0s -> 0.5s  (10×)
  oshwhub detail     2.0s -> 1.0s  ( 2×)
  oshwhub listing    2.0s -> 1.0s  ( 2×)
  modules.lceda CDN  0.2s          (already optimized)

Net effect on batch-50 plan: sleep total ~32min -> ~3min, walltime
~2h -> ~10-15min.

Key finding: the original 5s/req on Pro was set out of "logged-in
account is precious" caution with zero empirical evidence. Sustained
burst probe (25 distinct UUIDs at 0.5s, no recovery) showed 0/25 errors
and median latency 410ms — the caution was unjustified.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-04-29 00:57:35 +08:00
parent c474f8ad83
commit ed713fa557
2 changed files with 193 additions and 64 deletions

26
log.md
View File

@@ -4,6 +4,32 @@
---
## 2026-04-29 03:30 rate-limit benchmark 整理成正式报告
**Claude 会话**
把零散跑出来的 rate-limit ladder 探针结果整理成 `docs/sources/probe_rate_limit_results.md`,从临时增量笔记升级成正式 benchmark 文档。
**5 个 host 全部探完**
| Host | 旧 sleep | 新 sleep | 加速 |
|---|---:|---:|---:|
| `pro.lceda.cn/api/v4/...` | 5.0s | 0.5s | 10× |
| `lceda.cn/api/documents/...` | 5.0s | 0.5s | 10× |
| `oshwhub.com/<owner>/<path>` | 2.0s | 1.0s | 2× |
| `oshwhub.com/api/project` | 2.0s | 1.0s | 2× |
| `modules.lceda.cn/...` | 0.2s | 0.2s | — (已优化) |
**关键发现**:原 5s/req 完全是出于"Pro 要登录、被封号最痛"的心理顾虑而设没有实测依据。Pro API 实测 25 distinct UUID 连发 0/25 badmedian 410ms latencyQPS=2 完全经得住。Std doc endpoint 同样的故事。
**对 batch-50 的净效**sleep 总时间 32 min → 3 min约 10x整批 walltime 估算 ~2h → ~10-15 min。
报告结构TL;DR 总表 → 方法论(包括安全约束 + 限制)→ 5 个 host 各自详细数据 → 最终设置 → 复现指南 → 后续考虑。
下一步:直接跑 batch-50 计划的 Step 1详情页扫 license就行。
---
## 2026-04-29 03:00 跑完 5 块 Pro 项目 export发现并修两个 --all 崩溃路径
**Claude 会话**