vault backup: 2024-01-02 12:25:10

Affected files:
Corbia spider.md
This commit is contained in:
ed barz 2024-01-02 12:25:10 +01:00
parent 0391d7e080
commit 561a835150
1 changed files with 3 additions and 1 deletions

View File

@ -1,2 +1,4 @@
In order to index the web properly, corbia spider only
In order to index the web properly, corbia spider uses domain based templates.
For each domain, a custom python function will be used in order to extract the relevant information and store it as JSON before further processing.