27 Web crawlers visit websites every day. It is not so well known fact that more than half of the web traffic comes from robots, not from real users. By browsing through the server logs, one can encounter a great variety of robots that perform activities that are friendly or evil: […]