On this page you can watch in real-time visitors and bots browsing this website. For each visitor you can see the country of origin, time and page visited, IP address of bot or visitor, you can also click on the IP address to display a tooltip with map and additional information about this IP address. There is no need to reload the page, the data is updated automatically after each visit.
Loading visits...
If you are seeing the message above for too long, there might be some communication problem. Instead of live display, only the last visits are displayed.
Last page update: 28.07.2010 00:09:33
|
 Web crawlers or bots typically identify themselves to a Web server by using the User-agent field of an HTTP request. By using the user agent field it is possible to determine which crawlers have visited the web server and how often. The user agent field may include a URL where we can find out more information about the crawler. Spambots and other malicious Web crawlers are unlikely to place identifying information in the user agent field, or they may mask their identity as a browser or other well-known crawler. It is important for Web crawlers to identify themselves so that Web site administrators can contact the owner if needed. In some cases, crawlers may be accidentally trapped in a crawler trap or they may be overloading a Web server with requests, and the owner needs to stop the crawler. Identification is also useful for administrators that are interested in knowing when they may expect their Web pages to be indexed by a particular search engine.
If you are a web crawler, spider or bot then please respect robots.txt file. As you probably know, the Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable. Bad bots will end in spider trap.
|
