Facere/FacereDataset
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 2 Wiki Activity
Files
eee1a9b97ee90e8114ab938fa9cb25c2047cdd21
FacereDataset/data/raw/oshwhub/dc91a91e669349898d709a5ba02f5b5f/source/2d44d614ebd2462eab434ca66939f94b.epro2
Knowit 3282a028c4 Add EasyEDA Pro EPRO2 source ingestion (3/5 batch test) 
打通 oshwhub origin=pro 现代 Pro 3.x 工程的 EPRO2 源抓取链路。3/5
modern Pro 项目完整解出（共 8423 docs / 542 MB plain）：

- X86 主板        7374 docs / 481 MB plain (chain=85, editor=3.2.15)
- 220V 桌面电源     771 docs /  26 MB plain (chain=28, editor=3.2.69)
- ESP-VoCat       278 docs / 7.5 MB plain (chain=12, editor=3.2.91)

剩余 2/5 是 legacy Pro 2.x（立创泰山派 RK3566、梁山派），项目 meta
返回 branch_uuid=null + editorVersion="2.1.40"，没有 git-style chain
模型，文档直接挂在 boards[].sch/pcb 字段上，访问端点暂未挖通；元
数据落库 metadata.json，source/ 留空。

实现要点：
- fetch_pro_source(): 4 步流程（project → branch HEAD → structures
  → /branches/<B>/histories/<HEAD> 即返完整 chain，无需 ?limit 批量
  端点）+ 逐 history 走 AES-128-GCM 解密（16 字节 IV，pycryptodome
  原生支持）+ gunzip + 按 DOCHEAD 切 per-doc EPRO2 流
- EPRO2 解析坑：行末单 `|` 是行终止符不是字段分隔符，必须先
  rstrip("|") 再 split("||")，否则 payload JSON 解析失败 silently
  swallow 导致 cur_doc 不设 → 第一轮 X86 板 7374 docs 抽出来只剩 2 个
- docType 实测远不止 BOARD/PCB/SCH/SCH_PAGE，还含 SYMBOL /
  FOOTPRINT / DEVICE / BLOB / FONT / CONFIG —— Pro 把组件库快照也
  随项目存到 history，下游做 EPRO2→KiCad 转换时必须先把这些 lib
  doc 加载进 symbol cache
- Pro 2.x vs 3.x 是不同存储模型 —— 3.x 走 branch 模型（已打通），
  2.x 走 boards[] 直链（未打通）；判别条件：project meta 的
  branch_uuid 是否为 null

CLI 新增 --with-pro-source / --backfill-pro-source / --pro-cookie /
--origin（按 origin 字段服务端过滤 listing API），crawl_one() 按
origin=pro 自动 dispatch 到 Pro fetcher。

schema：docType 类型从 integer 放宽到 [integer, string, null]
（兼容 Std 的 1/3 + Pro 的 BOARD/SCH 等），新增 message_count 字段。

License 注意：本批 5 个项目全是 NC-SA / GPL，未达 Pro source doc
§4.2 Forge 白名单（MIT/BSD/Apache/CC0/CC-BY/CERN-OHL-P/Unlicense）。
按 CLAUDE.md "研究用、不再分发" 原则 raw 入库无碍；Forge 投影时
另过白名单。

详细技术细节见 docs/sources/easyeda_pro_source.md rev 3 + log.md。

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-28 21:45:52 +08:00

55 lines
13 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
{"type":"DOCHEAD","ticket":723}||{"docType":"FOOTPRINT","client":"5796efe0-71be-4764-a7be-8620972bb90b","uuid":"2d44d614ebd2462eab434ca66939f94b","updateTime":1736397442000,"version":"1650370863","user":{"uuid":"f6d958b048194965970a097419f0f68a","nickname":"重庆枫叶","username":"cqlcp","avatar":"//image.lceda.cn/avatars/2026/1/FneZQD4JKfDDm92UUIa483axw2OD9PF1E07L9Aby.webp"}}|
{"type":"DOCHEAD","ticket":724}||{"docType":"FOOTPRINT","client":"5796efe0-71be-4764-a7be-8620972bb90b","uuid":"2d44d614ebd2462eab434ca66939f94b","updateTime":1736397442000,"version":"1650370863","user":{"uuid":"f6d958b048194965970a097419f0f68a","nickname":"重庆枫叶","username":"cqlcp","avatar":"//image.lceda.cn/avatars/2026/1/FneZQD4JKfDDm92UUIa483axw2OD9PF1E07L9Aby.webp"}}|
{"type":"META","ticket":725,"id":"META"}||{"title":"CAP-SMD_BD6.3-L6.6-W6.6-LS7.2-FD","description":";SMD,D6.3xL5.7mm;SMD,D6.3xL6.1mm;SMD,D6.3xL8mm;SMD;SMD,D6.3xL5.8mm;SMD,D6.3xL6mm;SMD,D6.3xL7.7mm;SMD,D6.3xL5.5mm;SMD,D6.3xL5.2mm;SMD,D6.3xL5.4mm;SMD,D6.3xL5mm;SMD,6.3x7.7mm;SMD,6.3x5.4mm;SMD,6x6.3mm;SMD,6.3x8mm;SMD,D6.3xL10.2mm;SMD,D6.3xL4.5mm;-;SMD,D6.3xL5.3mm;SMD,D6.3xL5.9mm;SMD,D6.3xL7mm;SMD,5.8x6.3mm;CAP-SMD_BD6.3-L6.6-W6.6-LS7.2-FD;SMD_6.3X8.7;CAP-SMD_6.3X5.4;CAP-SMD_L6.6-W6.6-LS7.2;SMD,5.9x6.3mm;CAP-SMD;6.3x5.4;-SMD6.3/5.8;CAP-SMD_BD6.3-L6.6-W6.6-LS7.2;CAP_6.3*5.4mm;SMD,D6.3xL9mm;SMD-2/Ф6.3*8;C_220UF_25V;CAP-SMD_BD6.3-L6.6-W6.6-LS7.2-;CA_6.3*7.7;CAP-SMD-2P;SMD-6.3X5.8;CE_6.3x6.1;EC6.3*7.7;6.3φ×7.7L;CAP-smd-2P;220UF/16V;CAP6.3X7.7;SMD,6.3x5.8mm;铝电解电容6.3*7.7MM;CAP-SMD_BD6.3;SMD-6*6MM;SMD,6.3x5.9mm;CAP-SMD_BD6.3-L6.6-W6.6;SMD,D6.3xL6.5mm","tags":[],"source":"a8d660646e954707960dfbc6710bd327|0819f05c4eef4c71ace90d822a990e87"}|
{"type":"DOCHEAD"}||{"docType":"FOOTPRINT","client":"eb88272c1d316052","uuid":"2d44d614ebd2462eab434ca66939f94b","updateTime":1736397442000,"version":"1650370863","user":{"uuid":"f6d958b048194965970a097419f0f68a","nickname":"重庆枫叶","username":"cqlcp","avatar":"//image.lceda.cn/avatars/2026/1/FneZQD4JKfDDm92UUIa483axw2OD9PF1E07L9Aby.webp"}}|
{"type":"LAYER","ticket":1,"id":"[\"LAYER\",1]"}||{"layerType":"TOP","layerName":"Top Layer","use":true,"show":true,"locked":false,"activeColor":"#FF0000","activateTransparency":1,"inactiveColor":"#7F0000","inactiveTransparency":1}|
{"type":"LAYER","ticket":2,"id":"[\"LAYER\",2]"}||{"layerType":"BOTTOM","layerName":"Bottom Layer","use":true,"show":true,"locked":false,"activeColor":"#0000FF","activateTransparency":1,"inactiveColor":"#00007F","inactiveTransparency":1}|
{"type":"LAYER","ticket":3,"id":"[\"LAYER\",3]"}||{"layerType":"TOP_SILK","layerName":"Top Silkscreen Layer","use":true,"show":true,"locked":false,"activeColor":"#FFCC00","activateTransparency":1,"inactiveColor":"#7F6600","inactiveTransparency":1}|
{"type":"LAYER","ticket":4,"id":"[\"LAYER\",4]"}||{"layerType":"BOT_SILK","layerName":"Bottom Silkscreen Layer","use":true,"show":true,"locked":false,"activeColor":"#66CC33","activateTransparency":1,"inactiveColor":"#336619","inactiveTransparency":1}|
{"type":"LAYER","ticket":5,"id":"[\"LAYER\",7]"}||{"layerType":"TOP_PASTE_MASK","layerName":"Top Paste Mask Layer","use":true,"show":true,"locked":false,"activeColor":"#808080","activateTransparency":1,"inactiveColor":"#404040","inactiveTransparency":1}|
{"type":"LAYER","ticket":6,"id":"[\"LAYER\",8]"}||{"layerType":"BOT_PASTE_MASK","layerName":"Bottom Paste Mask Layer","use":true,"show":true,"locked":false,"activeColor":"#800000","activateTransparency":1,"inactiveColor":"#400000","inactiveTransparency":1}|
{"type":"LAYER","ticket":7,"id":"[\"LAYER\",5]"}||{"layerType":"TOP_SOLDER_MASK","layerName":"Top Solder Mask Layer","use":true,"show":true,"locked":false,"activeColor":"#800080","activateTransparency":1,"inactiveColor":"#400040","inactiveTransparency":1}|
{"type":"LAYER","ticket":8,"id":"[\"LAYER\",6]"}||{"layerType":"BOT_SOLDER_MASK","layerName":"Bottom Solder Mask Layer","use":true,"show":true,"locked":false,"activeColor":"#AA00FF","activateTransparency":1,"inactiveColor":"#55007F","inactiveTransparency":1}|
{"type":"LAYER","ticket":9,"id":"[\"LAYER\",13]"}||{"layerType":"DOCUMENT","layerName":"Document Layer","use":true,"show":true,"locked":false,"activeColor":"#FFFFFF","activateTransparency":1,"inactiveColor":"#7F7F7F","inactiveTransparency":1}|
{"type":"LAYER","ticket":10,"id":"[\"LAYER\",11]"}||{"layerType":"OUTLINE","layerName":"Board Outline Layer","use":true,"show":true,"locked":false,"activeColor":"#FF00FF","activateTransparency":1,"inactiveColor":"#7F007F","inactiveTransparency":1}|
{"type":"LAYER","ticket":11,"id":"[\"LAYER\",12]"}||{"layerType":"MULTI","layerName":"Multi-Layer","use":true,"show":true,"locked":false,"activeColor":"#C0C0C0","activateTransparency":1,"inactiveColor":"#606060","inactiveTransparency":1}|
{"type":"LAYER","ticket":12,"id":"[\"LAYER\",9]"}||{"layerType":"TOP_ASSEMBLY","layerName":"Top Assembly Layer","use":true,"show":true,"locked":false,"activeColor":"#33CC99","activateTransparency":1,"inactiveColor":"#19664C","inactiveTransparency":1}|
{"type":"LAYER","ticket":13,"id":"[\"LAYER\",10]"}||{"layerType":"BOT_ASSEMBLY","layerName":"Bottom Assembly Layer","use":true,"show":true,"locked":false,"activeColor":"#5555FF","activateTransparency":1,"inactiveColor":"#2A2A7F","inactiveTransparency":1}|
{"type":"LAYER","ticket":14,"id":"[\"LAYER\",14]"}||{"layerType":"MECHANICAL","layerName":"Mechanical Layer","use":true,"show":true,"locked":false,"activeColor":"#F022F0","activateTransparency":1,"inactiveColor":"#781178","inactiveTransparency":1}|
{"type":"LAYER","ticket":15,"id":"[\"LAYER\",52]"}||{"layerType":"COMPONENT_MODEL","layerName":"Component Model Layer","use":true,"show":true,"locked":false,"activeColor":"#FFFFFF","activateTransparency":1,"inactiveColor":"#7F7F7F","inactiveTransparency":1}|
{"type":"LAYER","ticket":16,"id":"[\"LAYER\",48]"}||{"layerType":"COMPONENT_SHAPE","layerName":"Component Shape Layer","use":true,"show":true,"locked":false,"activeColor":"#00CCCC","activateTransparency":1,"inactiveColor":"#006666","inactiveTransparency":1}|
{"type":"LAYER","ticket":17,"id":"[\"LAYER\",51]"}||{"layerType":"PIN_FLOATING","layerName":"Pin Floating Layer","use":true,"show":true,"locked":false,"activeColor":"#FF99FF","activateTransparency":1,"inactiveColor":"#7F4C7F","inactiveTransparency":1}|
{"type":"LAYER","ticket":18,"id":"[\"LAYER\",49]"}||{"layerType":"COMPONENT_MARKING","layerName":"Component Marking Layer","use":true,"show":true,"locked":false,"activeColor":"#66FFCC","activateTransparency":1,"inactiveColor":"#337F66","inactiveTransparency":1}|
{"type":"LAYER","ticket":19,"id":"[\"LAYER\",50]"}||{"layerType":"PIN_SOLDERING","layerName":"Pin Soldering Layer","use":true,"show":true,"locked":false,"activeColor":"#CC9999","activateTransparency":1,"inactiveColor":"#664C4C","inactiveTransparency":1}|
{"type":"ACTIVE_LAYER","ticket":20,"id":"ACTIVE_LAYER"}||{"layerId":51}|
{"type":"ACTIVE_LAYER","ticket":21,"id":"ACTIVE_LAYER"}||{"layerId":1}|
{"type":"CANVAS","ticket":22,"id":"CANVAS"}||{"originX":0,"originY":0,"unit":"mm","gridXSize":10,"gridYSize":10,"snapXSize":0.5,"snapYSize":0.5,"gridType":"NONE","multiGridType":"NONE","highlightValue":0.5}|
{"type":"ELE_PLACEHOLDER","ticket":23,"id":"placeholder1"}||{"dataType":"FILL","max":1}|
{"type":"FILL","ticket":24,"id":"e1"}||{"groupId":0,"netName":"","layerId":49,"width":0.2,"fillStyle":"SOLID","path":[["CIRCLE",-141.737,-129.925,2.361]],"locked":false,"zIndex":1,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":25,"id":"e2"}||{"groupId":0,"netName":"","layerId":13,"width":0.2,"fillStyle":"SOLID","path":[[-110.433,25.984,"L",-110.433,-25.984,-102.638,-25.984,-102.638,25.984,-110.433,25.984]],"locked":false,"zIndex":2,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":26,"id":"e3"}||{"groupId":0,"netName":"","layerId":13,"width":0.2,"fillStyle":"SOLID","path":[[-122.126,3.898,"L",-122.126,-3.898,-90.945,-3.898,-90.945,3.898,-122.126,3.898]],"locked":false,"zIndex":3,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":27,"id":"e4"}||{"groupId":0,"netName":"","layerId":13,"width":0.2,"fillStyle":"SOLID","path":[[122.126,3.898,"L",122.126,-3.898,90.945,-3.898,90.945,3.898,122.126,3.898]],"locked":false,"zIndex":4,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"ELE_PLACEHOLDER","ticket":28,"id":"placeholder2"}||{"dataType":"FILL","max":11}|
{"type":"FILL","ticket":29,"id":"e16"}||{"groupId":0,"netName":"","layerId":3,"width":0.2,"fillStyle":"SOLID","path":[[-110.433,-33.78,"L",-110.433,-85.748,-102.638,-85.748,-102.638,-33.78,-110.433,-33.78]],"locked":false,"zIndex":16,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":30,"id":"e17"}||{"groupId":0,"netName":"","layerId":3,"width":0.2,"fillStyle":"SOLID","path":[[-122.126,-55.866,"L",-122.126,-63.661,-90.945,-63.661,-90.945,-55.866,-122.126,-55.866]],"locked":false,"zIndex":17,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":31,"id":"e18"}||{"groupId":0,"netName":"","layerId":3,"width":0.2,"fillStyle":"SOLID","path":[[122.126,-55.866,"L",122.126,-63.661,90.945,-63.661,90.945,-55.866,122.126,-55.866]],"locked":false,"zIndex":18,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":32,"id":"e19"}||{"groupId":0,"netName":"","layerId":50,"width":0.2,"fillStyle":"SOLID","path":[[37.4,13.78,"L",141.73,13.78,141.73,-13.78,37.4,-13.78,37.4,13.78]],"locked":false,"zIndex":19,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"FILL","ticket":33,"id":"e20"}||{"groupId":0,"netName":"","layerId":50,"width":0.2,"fillStyle":"SOLID","path":[[-141.733,13.78,"L",-37.403,13.78,-37.403,-13.78,-141.733,-13.78,-141.733,13.78]],"locked":false,"zIndex":20,"isBridgingCopper":false,"networkList":[],"refs":[]}|
{"type":"ELE_PLACEHOLDER","ticket":34,"id":"placeholder3"}||{"dataType":"POLY","max":5}|
{"type":"POLY","ticket":35,"id":"e5"}||{"groupId":0,"netName":"","layerId":48,"width":2,"path":[129.921,129.921,"L",129.921,-129.921,-77.953,-129.921,-129.921,-77.953,-129.921,77.953,-77.953,129.921,129.921,129.921],"locked":false,"zIndex":5,"polyType":"NORMAL"}|
{"type":"ELE_PLACEHOLDER","ticket":36,"id":"placeholder4"}||{"dataType":"POLY","max":2}|
{"type":"POLY","ticket":37,"id":"e8"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[132.111,-29.105,"L",132.9,-132.9],"locked":false,"zIndex":8,"polyType":"NORMAL"}|
{"type":"POLY","ticket":38,"id":"e9"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[132.9,-132.9,"L",-78,-132.9],"locked":false,"zIndex":9,"polyType":"NORMAL"}|
{"type":"POLY","ticket":39,"id":"e10"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[-78,-132.9,"L",-132.9,-78],"locked":false,"zIndex":10,"polyType":"NORMAL"}|
{"type":"POLY","ticket":40,"id":"e11"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[-132.9,-78,"L",-132.374,-27],"locked":false,"zIndex":11,"polyType":"NORMAL"}|
{"type":"POLY","ticket":41,"id":"e12"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[132.657,27.862,"L",132.92,132.92],"locked":false,"zIndex":12,"polyType":"NORMAL"}|
{"type":"POLY","ticket":42,"id":"e13"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[132.92,132.92,"L",-77.954,132.92],"locked":false,"zIndex":13,"polyType":"NORMAL"}|
{"type":"POLY","ticket":43,"id":"e14"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[-77.954,132.92,"L",-132.92,77.954],"locked":false,"zIndex":14,"polyType":"NORMAL"}|
{"type":"POLY","ticket":44,"id":"e15"}||{"groupId":0,"netName":"","layerId":3,"width":6,"path":[-132.92,77.954,"L",-132.92,27],"locked":false,"zIndex":15,"polyType":"NORMAL"}|
{"type":"ELE_PLACEHOLDER","ticket":45,"id":"placeholder5"}||{"dataType":"PAD","max":6}|
{"type":"PAD","ticket":46,"id":"e6"}||{"groupId":0,"netName":"","layerId":1,"num":"2","centerX":105.113,"centerY":-0.005,"padAngle":0,"hole":null,"defaultPad":{"padType":"RECT","width":137.795,"height":47.244,"radius":0},"specialPad":[],"padOffsetX":0.005,"padOffsetY":0.005,"relativeAngle":0,"plated":true,"padType":"NORMAL","topSolderExpansion":null,"bottomSolderExpansion":null,"topPasteExpansion":null,"bottomPasteExpansion":null,"locked":false,"zIndex":6,"connectMode":null,"spokeSpace":null,"spokeWidth":null,"spokeAngle":null,"padLen":0}|
{"type":"PAD","ticket":47,"id":"e7"}||{"groupId":0,"netName":"","layerId":1,"num":"1","centerX":-105.117,"centerY":-0.005,"padAngle":0,"hole":null,"defaultPad":{"padType":"RECT","width":137.795,"height":47.244,"radius":0},"specialPad":[],"padOffsetX":-0.001,"padOffsetY":0.005,"relativeAngle":0,"plated":true,"padType":"NORMAL","topSolderExpansion":null,"bottomSolderExpansion":null,"topPasteExpansion":null,"bottomPasteExpansion":null,"locked":false,"zIndex":7,"connectMode":null,"spokeSpace":null,"spokeWidth":null,"spokeAngle":null,"padLen":0}|
{"type":"ELE_PLACEHOLDER","ticket":48,"id":"placeholder6"}||{"dataType":"ATTR","max":21}|
{"type":"ATTR","ticket":49,"id":"e21"}||{"groupId":0,"parentId":"","layerId":3,"x":null,"y":null,"key":"Footprint","value":"CAP-SMD_BD6.3-L6.6-W6.6-LS7.2-FD","keyVisible":false,"valueVisible":false,"fontFamily":"default","fontSize":67.5,"strokeWidth":6,"bold":false,"italic":false,"origin":"LEFT_BOTTOM","angle":0,"reverse":false,"expansion":0,"mirror":false,"locked":false,"zIndex":21}|
{"type":"ATTR","ticket":50,"id":"e22"}||{"groupId":0,"parentId":"","layerId":3,"x":null,"y":null,"key":"Designator","value":"U?","keyVisible":false,"valueVisible":false,"fontFamily":"default","fontSize":67.5,"strokeWidth":6,"bold":false,"italic":false,"origin":"LEFT_BOTTOM","angle":0,"reverse":false,"expansion":0,"mirror":false,"locked":false,"zIndex":22}|
Reference in New Issue View Git Blame Copy Permalink