Facere/FacereDataset
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 2 Wiki Activity

Add EasyEDA Std project source ingestion (10 boards backfilled)

Browse Source 
打通 oshwhub origin=std 项目的工程源（schematic + PCB dataStr）抓取链路。原
plan.md §1.6 假设需要登录，实测 lceda.cn/api/documents/<doc>?uuid=<doc>&path=<doc>
对公开项目匿名可访问 —— 无需 cookie，无账号封禁风险。

调研：4 轮探测留痕在 data/state/std_probe[1-5]/（gitignored）；翻 Std 编辑器
v6.5.51 的 main.min.js bundle 找到 ajaxDetail 端点；按 docType 区分两种
响应 shape（schematic 项目视图 vs PCB 文档视图）。

Crawler:
  - make_source_client() 用浏览器 UA + lceda.cn/editor Referer，因为
    oshwhub /api/project/<uuid> 端点拒绝 FacereDataset/0.1 UA（CLAUDE.md
    UA 例外条款：目标站主动封自定义 UA + 公开静态资源）
  - fetch_std_source(): 项目元 → version_documents → 逐文档 dataStr → 落
    source/<doc>.json + source/manifest.json
  - --with-source（爬新项目时一并抓源）/ --backfill-source（仅扫已有）
  - QPS ≤ 0.2 (SLEEP_SOURCE = 5s) 自律

Schema: 加 source_format / source_path / source_documents / editor_version
（前 3 进 enum 锁定，便于后续 Pro / KiCad 源对齐）。

回填结果：10/10 成功，45 个文档，33.2 MB；schema validate 全通。
docTypes 主要是 1 (schematic) 与 3 (pcb)；USB 电压电流表只有 PCB 文档（4 个：
主板+盖板+底板+面板，作者未上传原理图源）。

完整调研：docs/sources/easyeda_std_source.md。
This commit is contained in:
Knowit
2026-04-28 20:07:40 +08:00
parent b0d3afd2a9
commit d874278bc5
71 changed files with 4389 additions and 23 deletions
Download Patch File Download Diff File Expand all files Collapse all files

31
data/raw/oshwhub/f974b06d9c01470bb319e7df6d4512c9/metadata.json
View File

@@ -59,5 +59,34 @@
"public": true,
"publish": true,
"skipped_files": []
}
},
"source_format": "easyeda-std",
"source_path": "source/",
"source_documents": [
{
"doc_uuid": "996de21a7dc14ce5879731ce1e5ed40e",
"docType": 1,
"master": "c806967c27f7496daf3d7fd15f374059",
"path": "source/996de21a7dc14ce5879731ce1e5ed40e.json",
"size": 80142,
"sha256": "8f11b87e7e5dc0e88156888f95b5774ebcd246197111620afddd2117214581e1"
},
{
"doc_uuid": "d0d1804c9cfd4e49b5c2f0b346e6ee4b",
"docType": 3,
"master": "f82f694095fd41ef9cea98f98fab97f3",
"path": "source/d0d1804c9cfd4e49b5c2f0b346e6ee4b.json",
"size": 450225,
"sha256": "5dc32b84d89af967fe0590e37ba395a868f86cb1ff1e0aad0f032e693dac7976"
},
{
"doc_uuid": "d035908e00704da9bd72aacb68c5dd69",
"docType": 3,
"master": "e02cb4d00a7c4a43af23617eb305a988",
"path": "source/d035908e00704da9bd72aacb68c5dd69.json",
"size": 483574,
"sha256": "8bae58bb83a7c650bb4fdbe1faeb9b425604a2b23a01d72b306190579304d410"
}
],
"editor_version": "6.5.40"
}

1
data/raw/oshwhub/f974b06d9c01470bb319e7df6d4512c9/source/996de21a7dc14ce5879731ce1e5ed40e.json Normal file
View File

File diff suppressed because one or more lines are too long

1
data/raw/oshwhub/f974b06d9c01470bb319e7df6d4512c9/source/d035908e00704da9bd72aacb68c5dd69.json Normal file
View File

File diff suppressed because one or more lines are too long

1
data/raw/oshwhub/f974b06d9c01470bb319e7df6d4512c9/source/d0d1804c9cfd4e49b5c2f0b346e6ee4b.json Normal file
View File

File diff suppressed because one or more lines are too long

228
data/raw/oshwhub/f974b06d9c01470bb319e7df6d4512c9/source/manifest.json Normal file
View File

@@ -0,0 +1,228 @@
{
"project_uuid": "f974b06d9c01470bb319e7df6d4512c9",
"fetched_at": "2026-04-28T11:50:07.651091+00:00",
"editor_version": "6.5.40",
"documents": [
{
"doc_uuid": "996de21a7dc14ce5879731ce1e5ed40e",
"docType": 1,
"master": "c806967c27f7496daf3d7fd15f374059",
"path": "source/996de21a7dc14ce5879731ce1e5ed40e.json",
"size": 80142,
"sha256": "8f11b87e7e5dc0e88156888f95b5774ebcd246197111620afddd2117214581e1"
},
{
"doc_uuid": "d0d1804c9cfd4e49b5c2f0b346e6ee4b",
"docType": 3,
"master": "f82f694095fd41ef9cea98f98fab97f3",
"path": "source/d0d1804c9cfd4e49b5c2f0b346e6ee4b.json",
"size": 450225,
"sha256": "5dc32b84d89af967fe0590e37ba395a868f86cb1ff1e0aad0f032e693dac7976"
},
{
"doc_uuid": "d035908e00704da9bd72aacb68c5dd69",
"docType": 3,
"master": "e02cb4d00a7c4a43af23617eb305a988",
"path": "source/d035908e00704da9bd72aacb68c5dd69.json",
"size": 483574,
"sha256": "8bae58bb83a7c650bb4fdbe1faeb9b425604a2b23a01d72b306190579304d410"
}
],
"upstream_version_documents": [
{
"uuid": "996de21a7dc14ce5879731ce1e5ed40e",
"title": "图腾ZVS",
"description": "",
"docType": 1,
"master": "c806967c27f7496daf3d7fd15f374059",
"thumb": "//image.lceda.cn/histories/c806967c27f7496daf3d7fd15f374059.png",
"components": {
"0c284bd3dda3434fb509253d76639d9e": 4,
"f0bc163659d742bc8f021d00cdeb85b2": 12,
"51746bba824141b3a8814a56db200c95": 2,
"4963d1783cdf4ffe9a3aff11b154e5e7": 3,
"8850ffcdb9d242a1b431d4a3e2209db1": 2,
"7fbaebc0e18b4c429709f33234965991": 2,
"c89062f15c1547a689f6cb8a9be2247e": 2,
"62a5d91115c34b5b8d27e6b924c6c14e": 4,
"404aa9221ff94de597b8734806e7c74f": 2,
"b45e715fcf7943e8b6e0e342505a2f94": 2,
"579e30d1b3a3408da70a830a095aa862": 1,
"80ea8b7a20c444738d09e9ac83669d6e": 4,
"f683d879045247cebcf4fc430a9f10bc": 1
},
"updateTime": 1709211328,
"createTime": 1676392252,
"histories": [
"d0892796ac164a0fac72e274e32c5ad2",
"a858650c6d194d80a6007d176163f798",
"f3c9093e683b4032901938480391da67",
"d8d7209ecdf1425fa1619f97d3d59abe",
"17bf27f27a314e42a30e56ec738b7d02",
"a97212a1a0fc421e9791d1304c0a9225",
"97a0b9feadaa4c30b33af0c32c223be0",
"c57254c2915248a58d0064fd9750bd8d",
"ef18f2b063a746208e7c1ae417bfe99d",
"983956bf975f4a77992005480b8b0b4f",
"25b6738e68d94d0c8807281337b96f42",
"65ade52095eb4cb29bed4a1a5feb5bcd",
"1aa0f3781fb64d0c9c772fa8b2c6a678",
"5ebe18f84efb4ffeb4161b20d92b9c70",
"822badf1cdd94d8190f9f4506ba0c58f",
"7b72b4bba80d4256863fb457f0aae3b9",
"fc5aa5dfe694404cba7d7c93e72cfbc4",
"42e96489baaa41d5bf666fb585caffe3",
"437204e9dca54191a995fd6ef193be4b",
"1edc90eba7c14bb4a39429d6d8915896",
"11a92fd3c8394399b8f0f30c4affdc85",
"72215422e81e4e33944383ff8d63e5cf",
"de07f5f15cdc4bdb9b773bc192ac3f81",
"e13068d28fd346488a799783aafa2fb1",
"d4df3f7e32044f448596b1ca6fc79983",
"71413790741741d08b2a8279478ecc8d",
"00019fe3a51b491a9263824b99f843b3",
"b1ca34cbe7894e6d8e2626f501a88083",
"91e70f4c86804a16bf4b286bb97050ce",
"7d9723b4c5b742129e9eac45087a9692",
"5db9c6cc8ffc4d34857786e627c48f33",
"84efa76d40bf4089a3a8d17d6b7e211a",
"91c6d0ef4d744315abe2966cd8ac44e8",
"4a773a25b0574488be0564dd9ea67b08",
"da89cdb5c4e04dbcb658649d7769de28",
"acdb293d21f54fd7ac7661b5974f7e74",
"67a7b7a344544f2faac9781ae7166967",
"ebb282128dc540d6a523f83c4abdc3a7",
"14d2e29f45cd44c5a6e52989af185bce",
"54c23f2894ce47288b81d5f208fbc040",
"5572454cfeed4170a971414bdacab8b7",
"64818d3d4bc748059a4ccc69dc4087f1",
"4611e7813a324ea0976d2ef693818774",
"ce968693de3144288aca17f23389c4f8",
"387fc77589104b018c69febbff4e8fe5",
"83b488afdb384667b5423cf93de064e6",
"94845d9b2fa740bca70cd581d3f884b3",
"8a38fed5e1cc4065b0eacbac70564757",
"80ea06c114d74abd87b7396067a7e7d3",
"a4b0ad70d8a94be28e5824edcef4153b",
"077912a31ab549de80ffeb6153cf61ae",
"1dce001aaf0b4ef3893fbabf63c33cf7",
"d314dd28b07f4ca6a143ae68080ba8ec",
"f63ef85edabb42c5afea6ed4947c3a00",
"55cafe79a78145adad1eeb47086cde5c",
"515e2474fc7f41069837708b26bf7e30",
"e78d679d845140f7adbeaa61a2a8522c",
"ec0d350eff304f45836ed2a51b12492e",
"72575c5efacd4986b250eddce7538f42",
"0f9550a8a6fd41a4be6d0a98ed8d5d02",
"501c972b4a3c4e8391355a3ff8fac536",
"79222539444f473c9e630e2deeb3e7de",
"b57ef0ebdec7480d9835c378e5461ef7",
"330773b8047d4d028fe8757449a49b92",
"74e221a716e44815971658b147153c6f",
"77a2ffa13b854afb9739d77aeef52f19",
"14b51149c2264bf592b0e633e58d92bf",
"a01cb69ffac44f34b2102f68bec3a458",
"8304b9686e41438bada39ec04a351a58",
"718b8b1629a5465a98afc2459a9dfadd",
"6f439ef7fd5b48e9a2884ff8370ea808",
"3768afb6b4a447e09978b155ea08e868",
"c806967c27f7496daf3d7fd15f374059"
]
},
{
"uuid": "d0d1804c9cfd4e49b5c2f0b346e6ee4b",
"title": "增强型ZVS改V2.0电容1600V",
"description": "",
"docType": 3,
"master": "f82f694095fd41ef9cea98f98fab97f3",
"thumb": "//image.lceda.cn/histories/f82f694095fd41ef9cea98f98fab97f3.png",
"components": {
"f27e44e6596b41e7a14033a855961720": 4,
"76f9555d15a64313a75638de13e00860": 2,
"ce0ed154d45b41508e0debca8473ba07": 2,
"20a90b45ec5948e7a4018bc592093c8e": 4,
"5905db98cde4487fbb177070aa85bbe1": 12,
"b160805aa2fc457fa8e4e145ffe43c56": 1,
"1e6ffbe58bc3486eb0b6bb8c8df90308": 1,
"a430df778a2b48639c59dc11be8657f3": 2,
"4629ae3486bc437a897b88e2f9caee7d": 4,
"e11ceaa89f314274800b2770237db329": 4
},
"updateTime": 1712492419,
"createTime": 1678645117,
"histories": [
"ce3bbf92cc0f41e5b51424dd1ebccb8b",
"63b038a4eb334e63af7e27d0d4c2addb",
"a45ed541fa504975915e9d953e2e2d8f",
"0e1dbdab114d4bc8bd511fb64eb7bdda",
"9778201b2b674b52a2007704588dc5ab",
"cac9e6ce425b4e57936cc7a3e7971845",
"60f955002daa4d89adf579fd28007b4e",
"bde2e0f7c34946ad83bc96076de2f234",
"7ada45a7518f427c8742491261e7e685",
"92d572f81e0944e893bd48876bb7996f",
"8242ef437312427ead99bb45d283b01a",
"8e8c8a2153a04bd6978dfb729471c6b5",
"30444229cf024bcc919e1b49b2d72a0c",
"2f31466a2d784aa082a63429dc9d9a60",
"bc534be8dfa94de28fc132331b4eb2de",
"f65963c8cadc4111ba48f69bdf168826",
"b485b47b4a10416eadbc4ada6cf11ffd",
"002995ecf5ce487686a73cc8a8167797",
"895f468e46f840029d07c23421127289",
"af32248b47bb4be0b2a4cff799a98190",
"9c8394b2c970417594318243c854fb9f",
"0098792c8be5437f8f10ebc863bffaac",
"013fca493c674396b2313119ef5a19c0",
"3d24f4d40474414b94d690320bfe3d90",
"d33195ef12cb41d3af99157446d93a83",
"54dade4869054f009b59a9917256c626",
"22316cf2a55749a795a09ac636c2c333",
"1b39b8d599c54e03bfacd4b2bd557470",
"392879bfb3b248d89ce2657967713ce2",
"be3eac8c929047558928ae64395d3e4a",
"3d012ff99b9f476d8e511d740c5b4876",
"f82f694095fd41ef9cea98f98fab97f3"
]
},
{
"uuid": "d035908e00704da9bd72aacb68c5dd69",
"title": "增强型ZVS大功率感应加热二代",
"description": "",
"docType": 3,
"master": "e02cb4d00a7c4a43af23617eb305a988",
"thumb": "//image.lceda.cn/histories/e02cb4d00a7c4a43af23617eb305a988.png",
"components": {
"f27e44e6596b41e7a14033a855961720": 4,
"fc094921188e4c63a69b5a99b7b31586": 1,
"b160805aa2fc457fa8e4e145ffe43c56": 3,
"5905db98cde4487fbb177070aa85bbe1": 12,
"ce0ed154d45b41508e0debca8473ba07": 2,
"a430df778a2b48639c59dc11be8657f3": 2,
"4629ae3486bc437a897b88e2f9caee7d": 4,
"e11ceaa89f314274800b2770237db329": 4,
"20a90b45ec5948e7a4018bc592093c8e": 4,
"1e6ffbe58bc3486eb0b6bb8c8df90308": 1,
"76f9555d15a64313a75638de13e00860": 2
},
"updateTime": 1712930817,
"createTime": 1701022340,
"histories": [
"1f8092a8fddf46d0a315889d53cd3b26",
"fa2b11592a734ca9a5fc30698b3a12e4",
"86ddaa19d72c452f9f64da5aa7eebfbc",
"48500af1b7954e8aa334036be53b6f74",
"6afb937c09f948a1a712405dd2e9d9c6",
"5d10860f593d424992d97473d124632d",
"49265a96d0b94521838e4f62e65bb726",
"707666888d0f4a8cb758deb980c817b7",
"5661ccb366af49a7888cce973ad071a8",
"6e2b097fb45b4971bdc58beb2586c88c",
"0b4ad3902f69485a9bdc044e766c89d6",
"e5737add658c45bf8c26700b0f4f58e4",
"f7e4f4573e1a40569fe4c41b0e7df15f",
"e02cb4d00a7c4a43af23617eb305a988"
]
}
]
}