Knowit
29530e09d2
Topic-targeted pull from local listing index (`name OR introduction`
contains 飞控). 79 std hits in oshwhub_listing_full.jsonl, 2 already
crawled, 77 newly fetched.
dev1 (Guangzhou) walltime:
Step 1 detail scrape ~12s, Step 4 std-source backfill ~80s
(concurrency=5)
Source completeness: 73/77 with editor source, 4 are upstream
attachments-only (no editor session ever attached, source_documents=[]
is genuine — no editor_version on the SSR page either).
Crawler hardening (crawlers/oshwhub/crawler.py):
- count.{like,star,fork,views} are now `.get(..., 0)` defensive.
Listing API omits zero-valued fields for some low-activity entries
(3/77 hit this on first pass, hard-failed with KeyError 'like').
Affects rank_score, pick_top, and metadata.json metrics block.
License mix: 65% GPL 3.0, 11% Public Domain, 11% MIT, ~6% CC variants.
Transport: dev1 → SG via tar+scp (33 MB, ~3 min over lossy
cross-region link). Bypassed gitea push from dev1 because the same
6.5%-loss link tanks single-stream throughput.
61 lines
1.9 KiB
JSON
61 lines
1.9 KiB
JSON
{
|
||
"source": "oshwhub",
|
||
"source_url": "https://oshwhub.com/airbus15/matek-f405-wse-fei-kong-usb-ban-bu-fen",
|
||
"project_id": "8ee22e5a5bf9430ab1b87d738eca794c",
|
||
"title": "MATEK F405 WSE 飞控USB板部分",
|
||
"description_short": "用于MATEK F405 WSE滑翔机飞控的USB调参板，遵循FlyingRC的设计，也可用于MATEK使用6Pin接口的飞控。",
|
||
"description_path": "description.md",
|
||
"author": {
|
||
"username": "airbus15",
|
||
"display_name": "AIRBUS15",
|
||
"user_id": "83acabf1baa84c459694cba8906d7ee7"
|
||
},
|
||
"license": "GPL 3.0",
|
||
"tags": [],
|
||
"created_at": "2025-09-02T07:38:15.000Z",
|
||
"updated_at": "2025-09-02T08:17:42.000Z",
|
||
"published_at": "2025-09-02T09:39:50.000Z",
|
||
"crawled_at": "2026-04-30T10:57:07.017948+00:00",
|
||
"metrics": {
|
||
"likes": 0,
|
||
"stars": 2,
|
||
"forks": 0,
|
||
"views": 320,
|
||
"watch": 0,
|
||
"comments": 0
|
||
},
|
||
"cover": {
|
||
"url": "https://image.lceda.cn/oshwhub/pullImage/f709e6a6aec844928c0b0f3a20265ef2.jpg",
|
||
"path": null
|
||
},
|
||
"files": [],
|
||
"raw_fields": {
|
||
"path": "airbus15/matek-f405-wse-fei-kong-usb-ban-bu-fen",
|
||
"grade": 1,
|
||
"origin": "std",
|
||
"public": true,
|
||
"publish": true,
|
||
"skipped_files": []
|
||
},
|
||
"source_format": "easyeda-std",
|
||
"source_path": "source/",
|
||
"source_documents": [
|
||
{
|
||
"doc_uuid": "760c9c9ed3bd4e45983487675e56854d",
|
||
"docType": 1,
|
||
"master": "eb78c5aec5c34591acc416dbb8fdca60",
|
||
"path": "source/760c9c9ed3bd4e45983487675e56854d.json",
|
||
"size": 41977,
|
||
"sha256": "095240f396bf9e848f34c9e979368a5052971e514ba621a4614f4c8a08c8afe2"
|
||
},
|
||
{
|
||
"doc_uuid": "cb96751f53954fc29aafbac136b9eb74",
|
||
"docType": 3,
|
||
"master": "97f07aefd98e4f24a5dd339045ffb8f0",
|
||
"path": "source/cb96751f53954fc29aafbac136b9eb74.json",
|
||
"size": 188674,
|
||
"sha256": "18463920b5e1803e769528fdc6d4c13365612cf687dc4538dedc01d8b9022279"
|
||
}
|
||
],
|
||
"editor_version": "6.5.46"
|
||
} |