ai-web-research
確定性、無 LLM 依賴的 robots/sitemap-aware 爬蟲，輸出 LLM 可用 Markdown 與可續傳 frontier
Stage 1 AI crawler: deterministic robots/sitemap-aware crawling with SSRF guard, Crawl4AI fetch, SHA-256 dedup
最後更新：2026-07-19T11:07:33.109325+00:00
證據鏈（Evidence）
| 欄位 | 值 | 來源 | Tier | 抓取時間 | 信心 |
|---|---|---|---|---|---|
| archived | 否 | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| description | Stage 1 AI crawler: deterministic robots/sitemap-aware crawling with SSRF guard, Crawl4AI fetch, SHA-256 dedup | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| license | NOASSERTION | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| license_hint_from_doc | MIT | D:\我的研究\未來計畫區\網路爬蟲_AI爬蟲與Agent自動化搜尋技術整理_2026-07-14.md | 3 | 2026-07-19T11:07:33.109325+00:00 | 0.8 |
| open_issues | 0 | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| page_title | GitHub - kakon77777-commits/ai-web-research: Stage 1 AI crawler: deterministic robots/sitemap-aware crawling with SSRF guard, Crawl4AI fetch, SHA-256 dedup | https://github.com/kakon77777-commits/ai-web-research | 2 | 2026-07-19T11:07:33.109325+00:00 | 0.9 |
| pushed_at | 2026-07-19T06:35:44Z | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| stars | 0 | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |
| topics | — | https://api.github.com/repos/kakon77777-commits/ai-web-research | 1 | 2026-07-19T11:07:33.109325+00:00 | 0.99 |