Crawler Dashboard
Monitor crawl activity and manage sites
language
12
Sites
inventory_2
4,523
Items
list
1,250
List
block
89
Irrelevant
error
23
Error
delete
156
Deleted
historyRecent Crawls
| Date | SiteID | URL | PageID | Agent | Status | Error | Time |
|---|---|---|---|---|---|---|---|
| 2026-01-27 23:05:40 | site-1 | page-1 | smart_toyOrchestrator | 200 | 150 ms | ||
| 2026-01-27 22:05:40 | site-2 | page-2 | smart_toyOrchestrator | 200 | 230 ms | ||
| 2026-01-27 21:05:40 | site-1 | page-3 | smart_toyOrchestrator | 404 | Not found | 45 ms |