 |
Support: site spiders
When your service involves a search page for your web site,
this means that Eidetica will be spidering your site one
up to many times a day, according to the Service Level
Agreement between you and Eidetica.
Some hints about site spiders:
-
The site spiders can be recognised in your server logs
as coming from "gitane.eidetica.com" with user agent
"wget" or the Eidetica spidering software (which identifies
itself as Mozilla but contains a link to the page about our
spider policy).
-
After your site has been spidered, it may take up to 30 minutes
until the site has been indexed and your search service will
be up to date.
-
Currently, we recognise "site search" and "site archives".
The first re-retrieves your site each time; the second keeps
adding content to the index, assuming your files will never be
deleted. A third, optional version continuously monitors your
site and keeps the index up to date which exactly that which can
be "reached" from your home page.
-
You can request overviews of spidering times on your service page.
-
Eidetica employs "intelligent spidering". This means that any
items that appear on all of your pages, such as navigation
items, will be skipped and as a consequence, cannot be searched.
This substantially increases the quality of the t·find
system and suggestions functionality.
|
|
