In order to index the web properly, corbia spider uses domain based templates.
For each domain, a custom python function will be used in order to extract the relevant information and store it as JSON before further processing.