From 561a8351507a48188da9570063b05247b13d3145 Mon Sep 17 00:00:00 2001 From: ed Date: Tue, 2 Jan 2024 12:25:10 +0100 Subject: [PATCH] vault backup: 2024-01-02 12:25:10 Affected files: Corbia spider.md --- Corbia spider.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/Corbia spider.md b/Corbia spider.md index 8c93f61..0928e59 100644 --- a/Corbia spider.md +++ b/Corbia spider.md @@ -1,2 +1,4 @@ -In order to index the web properly, corbia spider only \ No newline at end of file +In order to index the web properly, corbia spider uses domain based templates. + +For each domain, a custom python function will be used in order to extract the relevant information and store it as JSON before further processing. \ No newline at end of file