For more information... RTFM!
NAVIGATION
PAGES THAT LINK HERE
ACCOUNT LOGIN

You are not logged in

Powered by Interchange version 5.7.0

RobotIP

Defines a list of IP addresses that will be recognised as crawler robots (search engine spiders).

Synopsis

RobotIP  ip_address [, ip_addresses...]

Scope

This directive is only available for use in the global (interchange.cfg) configuration file, and will affect all websites running under the Interchange installation.  It will not work in a website's local (catalog.cfg) configuration file. 

Description

This directive defines a list of IP addresses that will be recognised as crawler robots (search engine spiders).  Requests coming from the listed IP addresses will cause Interchange to alter its behaviour to improve the chance of Interchange-served content being crawled and listed.

This directive accepts a wildcard list;  The "*" character represents any number of characters.  and the "?" character represents any single character.  For example, "208.146.26.*" would match "208.146.26.0" through "208.146.26.255".

If a client is recognised as a robot, the following will be performed by Interchange:

  • The mv_tmp_session CGI value will be set true, causing sessions to be disabled and therefore avoiding need to read and write session data to from/to the disk.  This also causes Interchange to generate URIs without including a session ID.
  • The mv_session_id CGI value will be set to "nsession".
  • The mv_no_count CGI value will be set true, causing Interchange to generate URIs without including an incremental "page count" number.

Warning

Warning

Once you have discovered that you are serving a page to a robot, you should not use this knowledge to massively alter your page content in an attempt to improve your search results ranking.  Doing so will stand you a good chance of being blacklisted by the search engine maintainers.

Example

RobotIP <<EOR
    202.9.155.123,   204.152.191.41,   208.146.26.19,
    208.146.26.233,  209.185.141.209,  209.185.141.211,
    209.202.148.36,  209.202.148.41,   216.200.130.207,
    216.35.103.6?,   216.35.103.70,
EOR

See also

Category:  Global config directives
Last modified by: Kevin Walsh
Modification date: Sunday 8 October 2006 at 5:27 PM (EDT)
Home  |  Legal nonsense  |  Privacy policy  |  Donations  |  Contact us