KOTETU: The Prefetching Proxy Server

KOTETU is a prefetching proxy server for World-Wide Web. The program prefetchs pages which were linked from browser retreived page. It makes improvment of response and retrieval time of browser side.

This project is derived from WWW Collector which is the first prefetching proxy server in the world.

Topics

• The official report of 4th Cache-Off by TMF is available.
• Source(version 1.5c1) in the 4th Cache-Off machine is available .
• Later version 1.5c, some parameters in Makefile are changed.
• Kotetu team entried 4th Cache-Off with version 1.5 (Sep 11, 2001).
• Later version 1.5b, some parameters in configuration file are changed.
• Version 1.2 is available. Objects over filesystem are constant size in this version, It improves file handling overhead of open() and others.

Features

• Proxy access -- gather accesses for external networks.
• WWW object caching -- save the bandwidth of your external network.
• Content-base prefetching -- save your waiting time.
  • Linked pages
  • Inclueded images

And it is known as:

• Free, open source program
• User-land program

Benefits

• Most of waiting time are reduced.
• Cheap cache server is available.

Platforms

Current version is developed upon Linux 2.2.x and 2.4.x (RedHat 6.2 and 7.1). You can run the program by easy installation upon these plathome. However, early versions were developed under IRIX 6.3 and FreeBSD. You may can run such platforms.

Requirements

Software:

• UNIX like OS
• C compiler
• Network library via BSD socket interface
• POSIX thread library (which is called 'pthread')

Hardware:

• 128MB memory space (recommended over 512MB)
• 4GB disk space (recommended over 18GB)

Sources

• Modern Versions
• Museum for historical study in WWW caching

The target of this program is work-group and/or department caching server up to 100Mbps bandwidth. Using entry server class PC, the program passes 300 replys per second workload by polygraph with polymix-4. You will get more higher performance when you use more a powerful machine or an array of them.

The bottole neck of this program is disk access. We suggest you using of faster disk sub system. Many disks, RAID card and fast filesystem makes it. For bursty traffic, memory upgrage is useful, also.

Prefetching will increase your external network bandwidth. Thought our operations during many years, a prefeching of 10 linked pages brings over 50% hit-ratio and 200% bandwidth. You can tune these parameters. You can disable prefetching feature, if you don't need.

Conntact

Please send e-mail to < k-chinen @ is.naist.jp > . When you send bug reports, please describe package name (version) and platform.

Author

Ken-ichi Chinen

Designe and implementation all of package

Contributors

Mikio Nagahara

Debug several procedures

Eiji Kawai, Yusuke Fujita

Debug several procedures and testing

Kadohi Ohsuga

Implements DHR routines (KOTETU varient)

Atsushi Mino, Ichiro Nishiuma

Testing

Related Pages

• TMF Cache-Off (or IRCache Bake-Off)
• Polygraph
• WWW Collector (Wcol)

Appendix

Kotetu - One of famous series of KATANA (Japanese sward) or manufactures of them. Kotetu is known also as belonging of Isami Kondo, which was one of leader of SINSEN GUMI. It is like a relationship between Excalibur and King Arthur.

last update: 2001 Nov 21
URL: http://infonet.naist.jp/products/kotetu/