|
Spidering Policy
The Eidetica web-crawler visits thousands of webpages every day. These
webpages are stored in Eidetica's database and are used for Internet search
engines and Internet content classification.
It is important to us that our web-crawler does not hinder you in any
way; our web-crawler will follow directions about spidering your website
if these are present. The web-crawler will also only make a limited number
of simultaneous requests to your website at any one time.
By using a robots file you can direct web-crawlers to ignore part or all of
your website. You can find more information about this on the following
webpage:
http://www.robotstxt.org/wc/robots.html
If you have any further questions about our web-crawler in regards to your
website, please contact us via email (support@eidetica.com) or by telephone
+31 88 88 222 11.
|