-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On Fri, 1 Jun 2007 14:37:35 +0200 (CEST)
"Thomas Falkeborg" <thomas@falkeborg.dk> wrote:
> Hi folks,
> i'm running squid for about 30 users with a very close to standard setup.
> The proxy is transparrent to the users. I increased the cache size to 14 G
> and have allocated about 512 mb ram. Apart from that the conf is standard.
>
> Below I enclose a "calamaris statistic report", which is where my trouble
> begins. I often have a negative average speed increase, and my byte hit
> ratio is bad - approxematly 3-5 % allthough I get a good request hit
> ratio.
>
> My hope is that anyone by looking at the report can help me improve the
> overall proxy performance. If needed I'll enclose the squid.conf file.
>
> # Summary
> Calamaris statistics
> --------------------------------------------------------- --------------
> ------
> lines parsed: lines
> 126047
> invalid lines: lines
> 0
> parse time: sec
> 41
> parse speed: lines/sec
> 3074
> --------------------------------------------------------- --------------
> ------
> Proxy statistics
> --------------------------------------------------------- --------------
> ------
> Total amount: requests
> 126047
> unique hosts/users: hosts
> 34
> Total Bandwidth: Byte
> 3360M
> Proxy efficiency (HIT [kB/sec] / DIRECT [kB/sec]): factor
> 0.66
> Average speed increase: %
> -2.28
> TCP response time of 100% requests: msec
> 755
> --------------------------------------------------------- --------------
> ------
> Cache statistics
> --------------------------------------------------------- --------------
> ------
> Total amount cached: requests
> 47735
> Request hit rate: %
> 37.87
> Bandwidth savings: Byte
> 150M
> Bandwidth savings in Percent (Byte hit rate): %
> 4.47
> Average cached object size: Byte
> 3299
> Average direct object size: Byte
> 42980
> Average object size: Byte
> 27952
> --------------------------------------------------------- --------------
> ------
>
>
> # Incoming requests by method
> method request % sec/req Byte %
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> GET 123481 97.96 0.75 3433347K 99.79
> 36.99
> POST 2294 1.82 0.99 7395777 0.21
> 3.19
> HEAD 235 0.19 0.20 99037 0.00
> 2.05
> NONE 20 0.02 0.00 29096 0.00
> 1092.85
> PROPFIND 13 0.01 0.11 17371 0.00
> 12.06
> OPTIONS 4 0.00 0.06 3280 0.00
> 14.43
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 126047 100.00 0.75 3440715K 100.00
> 36.17
>
>
> # Incoming UDP-requests by status
> no matching requests
>
>
> # Incoming TCP-requests by status
> status request % sec/req Byte %
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> HIT 47735 37.87 0.13 153786K 4.47
> 24.33
> TCP_IMS_HIT 26661 21.15 0.02 9833998 0.28
> 18.76
> TCP_REFRESH_HIT 9925 7.87 0.55 78555994 2.23
> 14.15
> TCP_HIT 5286 4.19 0.06 58741309 1.67
> 188.53
> TCP_NEGATIVE_HIT 2960 2.35 0.01 3513393 0.10
> 102.69
> TCP_MEM_HIT 2903 2.30 0.02 6832080 0.19
> 134.31
> MISS 78288 62.11 1.13 3286878K 95.53
> 37.01
> TCP_MISS 74323 58.96 1.15 3254574K 94.59
> 38.24
> TCP_REFRESH_MISS 3668 2.91 0.64 31017023 0.88
> 12.91
> TCP_CLIENT_REFRESH_MISS 297 0.24 4.57 2063016 0.06
> 1.48
> ERROR 24 0.02 0.00 51692 0.00
> 1147.28
> TCP_DENIED 24 0.02 0.00 51692 0.00
> 1147.28
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 126047 100.00 0.75 3440715K 100.00
> 36.17
>
>
> # Outgoing requests by status
> status request % sec/req Byte %
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> DIRECT Fetch from Source 88219 100.00 1.07 3364765K 100.00
> 35.70
> DIRECT 88219 100.00 1.07 3364765K 100.00
> 35.70
> SIBLING 0 0.00 0.00 0 0.00
> 0.00
> PARENT 0 0.00 0.00 0 0.00
> 0.00
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 88219 100.00 1.07 3364765K 100.00
> 35.70
>
>
> # Outgoing requests by destination
> neighbor type request % sec/req Byte %
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> DIRECT 88219 100.00 1.07 3364765K 100.00
> 35.70
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 88219 100.00 1.07 3364765K 100.00
> 35.70
>
>
> # Request-destinations by 2nd-level-domain
> destination request % hit-% Byte %
> hit-%
> -------------------------------- --------- ------ ------ -------- ------
> ------
> *.cafeen.org 5937 4.71 93.72 6801134 0.19
> 54.69
> <error> 5305 4.21 55.44 6872343 0.20
> 51.06
> *.dr.dk 4842 3.84 73.38 730135K 21.22
> 1.07
> *.travian.dk 3279 2.60 32.08 8640691 0.25
> 18.21
> *.dba.dk 3228 2.56 66.51 14169266 0.40
> 10.43
> *.msn.com 2851 2.26 18.10 11143648 0.32
> 5.57
> statistik-gallup.net 2466 1.96 0.00 1414712 0.04
> 0.00
> *.myspace.com 2180 1.73 17.29 28930777 0.82
> 4.89
> *.google.com 2129 1.69 5.78 30745388 0.87
> 0.90
> *.mymusic.dk 2110 1.67 35.21 228983K 6.66
> 0.12
> *.berlingske-mail.dk 1897 1.50 96.26 1067141 0.03
> 80.67
> ekstrabladet.dk 1785 1.42 12.89 4375244 0.12
> 14.28
> *.myspacecdn.com 1730 1.37 21.56 454945K 13.22
> 0.48
> dkbn.dk 1452 1.15 55.10 11947861 0.34
> 3.03
> *.lego.com 1379 1.09 23.93 5892238 0.17
> 1.86
> *.momondo.com 1365 1.08 32.01 4259281 0.12
> 5.62
> *.adtech.de 1318 1.05 1.29 1424658 0.04
> 0.25
> *.youtube.com 1223 0.97 22.16 122194K 3.55
> 0.30
> *.klassik.dk 1198 0.95 32.05 3904904 0.11
> 3.43
> *.flickr.com 1161 0.92 2.67 21110460 0.60
> 1.85
> other: 2110 2nd-level-domains 77212 61.26 33.70 1745571K 50.73
> 7.34
> -------------------------------- --------- ------ ------ -------- ------
> ------
> Sum 126047 100.00 37.87 3440715K 100.00
> 4.47
>
>
> # Request-destinations by toplevel-domain
> destination request % hit-% Byte %
> hit-%
> -------------------------------- --------- ------ ------ -------- ------
> ------
> *.dk 48026 38.10 48.94 1249551K 36.32
> 3.62
> *.com 45732 36.28 25.12 1748592K 50.82
> 3.53
> *.net 8299 6.58 20.29 245920K 7.15
> 3.75
> *.org 7309 5.80 81.71 39343871 1.12
> 20.55
> <error> 5305 4.21 55.44 6872343 0.20
> 51.06
> <unresolved> 3638 2.89 12.20 70001247 1.99
> 6.84
> *.de 1680 1.33 12.14 7873640 0.22
> 12.74
> *.cn 960 0.76 54.27 2766639 0.08
> 6.28
> *.info 836 0.66 23.56 13495337 0.38
> 9.91
> *.pl 751 0.60 0.13 309584 0.01
> 1.81
> *.se 539 0.43 3.71 1199302 0.03
> 2.50
> *.fr 428 0.34 31.07 9620581 0.27
> 21.82
> *.es 428 0.34 0.23 1564132 0.04
> 1.63
> *.uk 360 0.29 30.83 2717396 0.08
> 9.77
> *.biz 329 0.26 50.76 2293951 0.07
> 29.66
> *.edu 325 0.26 1.85 7511238 0.21
> 54.58
> *.us 202 0.16 69.80 13502787 0.38
> 71.94
> *.eu 172 0.14 18.60 1147106 0.03
> 7.36
> *.no 143 0.11 1.40 2345350 0.07
> 11.87
> *.au 122 0.10 2.46 161752 0.00
> 4.51
> other: 28 top-level-domains 463 0.37 35.21 18646026 0.53
> 13.01
> -------------------------------- --------- ------ ------ -------- ------
> ------
> Sum 126047 100.00 37.87 3440715K 100.00
> 4.47
>
>
> # TCP-Request-protocol
> protocol request % hit-% Byte %
> hit-%
> -------------------------------- --------- ------ ------ -------- ------
> ------
> http: 120742 95.79 37.10 3434004K 99.80
> 4.38
> <error> 5305 4.21 55.44 6872343 0.20
> 51.06
> -------------------------------- --------- ------ ------ -------- ------
> ------
> Sum 126047 100.00 37.87 3440715K 100.00
> 4.47
>
>
> # Requested content-type
> content-type request % hit-% Byte %
> hit-%
> -------------------------------- --------- ------ ------ -------- ------
> ------
> image/gif 38897 30.86 61.94 102731K 2.99
> 44.54
> image/jpeg 26678 21.17 30.94 321255K 9.34
> 19.50
> text/html 23512 18.65 3.57 194778K 5.66
> 1.27
> <unknown> 8032 6.37 36.77 2953716 0.08
> 30.40
> application/x-javascript 7345 5.83 45.38 27856728 0.79
> 27.45
> <error> 5305 4.21 55.44 6872343 0.20
> 51.06
> text/css 3033 2.41 59.48 11928551 0.34
> 36.07
> image/png 2769 2.20 67.39 15192812 0.43
> 40.76
> text/xml 2282 1.81 4.95 5610341 0.16
> 1.64
> text/plain 2018 1.60 4.56 488498K 14.20
> 1.55
> application/x-shockwave-flash 1892 1.50 20.51 73785996 2.09
> 5.71
> text/javascript 1319 1.05 46.55 3214408 0.09
> 15.34
> application/octet-stream 1000 0.79 18.80 243926K 7.09
> 0.08
> audio/mpeg 505 0.40 0.79 670022K 19.47
> 0.01
> application/zip 238 0.19 1.26 3253937 0.09
> 18.50
> image/x-icon 222 0.18 52.25 638332 0.02
> 56.70
> application/xml 167 0.13 37.13 659342 0.02
> 12.07
> image/pjpeg 127 0.10 0.00 553810 0.02
> 0.00
> application/x-mms-framed 78 0.06 0.00 705775K 20.51
> 0.00
> video/x-ms-asf 73 0.06 4.11 57413 0.00
> 3.39
> other: 56 content-types 555 0.44 12.61 564728K 16.41
> 1.30
> -------------------------------- --------- ------ ------ -------- ------
> ------
> Sum 126047 100.00 37.87 3440715K 100.00
> 4.47
>
>
> # Requested extensions
> extensions request % hit-% Byte %
> hit-%
> -------------------------------- --------- ------ ------ -------- ------
> ------
> <dynamic> 36478 28.94 0.38 1689769K 49.11
> 0.03
> gif 35311 28.01 72.83 99698830 2.83
> 47.40
> jpg 26492 21.02 34.29 277642K 8.07
> 22.21
> js 5600 4.44 73.71 18959700 0.54
> 45.14
> <error> 5305 4.21 55.44 6872343 0.20
> 51.06
> <none> 4575 3.63 7.83 34990326 0.99
> 3.99
> css 2856 2.27 66.98 9386898 0.27
> 45.70
> png 2616 2.08 74.24 11648394 0.33
> 53.32
> php 1163 0.92 5.85 7605359 0.22
> 0.33
> xml 1015 0.81 17.93 2426912 0.07
> 6.19
> html 816 0.65 14.83 8604816 0.24
> 5.51
> swf 613 0.49 66.23 44421312 1.26
> 9.68
> htm 512 0.41 27.73 6174349 0.18
> 3.68
> asp 414 0.33 5.80 2856910 0.08
> 1.34
> ico 365 0.29 36.99 955532 0.03
> 41.36
> aspx 320 0.25 0.00 5041846 0.14
> 0.00
> JPG 317 0.25 31.86 5909269 0.17
> 12.49
> jpeg 228 0.18 57.46 1438056 0.04
> 28.08
> flv 71 0.06 21.13 416471K 12.10
> 2.22
> wmv 48 0.04 0.00 468082K 13.60
> 0.00
> other: 107 extensions 932 0.74 20.49 328017K 9.53
> 1.89
> -------------------------------- --------- ------ ------ -------- ------
> ------
> Sum 126047 100.00 37.87 3440715K 100.00
> 4.47
>
>
> # Incoming UDP-requests by host
> no matching requests
>
>
> # Incoming TCP-requests by host
> host request hit-% sec/req Byte hit-%
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> 192.168.0.251 23794 51.23 0.43 680523K 7.72
> 67.25
> 192.168.0.231 13864 31.61 0.36 121489K 16.62
> 24.60
> 192.168.0.241 11883 45.57 0.46 222074K 5.12
> 40.50
> 192.168.0.79 8474 26.54 0.18 42479278 9.27
> 27.33
> 192.168.0.244 8173 29.17 1.09 260161K 1.03
> 29.34
> 192.168.0.118 6506 30.03 0.33 167104K 1.76
> 76.75
> 192.168.0.242 5407 26.91 5.38 501600K 1.09
> 17.26
> 192.168.0.139 4371 64.42 0.16 8762011 34.39
> 12.08
> 192.168.0.126 4096 22.46 0.58 84831104 10.94
> 34.71
> 192.168.0.227 4079 42.73 1.05 290881K 2.63
> 67.79
> 192.168.0.58 4010 39.40 0.16 53297233 8.82
> 83.35
> 192.168.0.32 3821 23.45 0.14 24276371 2.93
> 44.05
> 192.168.0.221 3580 30.11 0.33 180426K 3.70
> 152.66
> 192.168.0.56 2977 29.73 0.24 22034040 4.47
> 30.70
> 192.168.0.170 2940 55.17 1.58 427911K 0.89
> 91.89
> 192.168.0.236 2323 36.20 0.88 54787387 8.07
> 26.30
> 192.168.0.235 1927 45.98 1.92 6839339 12.38
> 1.80
> 192.168.0.68 1697 52.33 1.22 182109K 0.68
> 87.75
> 192.168.0.81 1596 45.80 0.56 20251574 22.19
> 22.28
> 192.168.0.228 1528 24.67 0.62 30664557 4.75
> 31.62
> other: 14 requesting hosts 9001 27.13 0.07 67969233 9.33
> 0.70
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 126047 37.87 0.75 3440715K 4.47
> 36.17
>
>
> # Size Distribution Diagram
> object-size (bytes) request hit-% sec/req Byte hit-%
> kB/sec
> ------------------------------ --------- ------ ------- -------- ------
> -------
> 0-0 785 6.24 1.08 0 0.00
> 0.00
> 100-999 67281 54.48 0.18 31354112 45.28
> 2.52
> 1000-9999 40912 21.05 0.61 143237K 19.71
> 5.78
> 10000-99999 15613 14.26 0.99 402277K 13.74
> 26.03
> 100000-999999 976 19.16 2.94 219705K 19.46
> 76.69
> 1000000-9999999 434 2.07 69.47 1181480K 1.16
> 39.19
> 10000000-99999999 45 0.00 194.29 1314789K 0.00
> 150.38
> 100000000-999999999 1 0.00 141.81 148608K 0.00
> 1047.96
> ------------------------------ --------- ------ ------- -------- ------
> -------
> Sum 126047 37.87 0.75 3440715K 4.47
> 36.17
>
>
> # Performance in 1 hour steps
> incomin hit miss direct sibling
> fetch
> date request Byte kB/sec kB/sec kB/sec kB/sec kB/sec
> kB/sec
> --------------- --------- ----- ------- ------- ------- ------- -------
> -------
> 30.May 07 06:00 979 12M 64.36 20.33 73.51 66.92 - -
> 30.May 07 07:00 1832 21M 27.45 15.64 31.88 25.49 - -
> 30.May 07 08:00 1579 11M 39.75 105.22 32.54 33.66 - -
> 30.May 07 09:00 2094 12M 33.29 34.54 33.22 32.90 - -
> 30.May 07 10:00 2550 69M 59.44 8.62 66.21 60.04 - -
> 30.May 07 11:00 2564 10M 23.40 62.73 18.94 21.28 - -
> 30.May 07 12:00 7590 257M 57.14 105.53 56.04 55.86 - -
> 30.May 07 13:00 11080 346M 34.74 60.53 34.11 34.26 - -
> 30.May 07 14:00 3610 44M 9.01 11.58 8.93 8.90 - -
> 30.May 07 15:00 5150 162M 27.04 39.54 26.77 26.77 - -
> 30.May 07 16:00 10327 306M 38.23 28.93 38.55 37.81 - -
> 30.May 07 17:00 18339 290M 17.40 39.68 16.72 17.01 - -
> 30.May 07 18:00 13404 209M 28.56 46.13 27.62 27.60 - -
> 30.May 07 19:00 7679 92M 17.05 50.22 15.64 16.71 - -
> 30.May 07 20:00 8380 220M 28.76 38.72 28.55 28.47 - -
> 30.May 07 21:00 11279 343M 73.69 84.77 72.81 72.59 - -
> 30.May 07 22:00 7412 125M 27.25 23.98 27.37 27.15 - -
> 30.May 07 23:00 3694 58M 59.56 27.93 62.90 60.96 - -
> 31.May 07 00:00 3792 689M 91.52 1.94 148.86 91.45 - -
> 31.May 07 01:00 2583 81M 54.76 86.85 53.56 54.82 - -
> 31.May 07 02:00 40 218K 25.03 6.08 25.50 24.94 - -
> 31.May 07 03:00 43 229K 20.23 1.36 20.56 20.23 - -
> 31.May 07 04:00 19 129K 15.90 - 15.90 15.90 - -
> 31.May 07 05:00 14 127K 21.65 - 21.65 21.65 - -
> 31.May 07 06:00 14 43455 12.89 - 12.89 12.89 - -
> --------------- --------- ----- ------- ------- ------- ------- -------
> -------
> overall 126047 3360M 36.17 24.33 37.01 35.70 - -
>
>
> # UDP-Request duration distribution in msec
> no matching requests
>
>
>
> # TCP-Request duration distribution in msec
> time request % hit-% sec/req Byte % hit-%
> kB/sec
> ---------------- --------- ------ ------ ------- -------- ------ ------
> -------
> <= 0.1 6481 5.14 98.86 0.00 4554606 0.13 100.00
> 6862.92
> <= 0.2 6481 5.14 98.86 0.00 4554606 0.13 100.00
> 6862.92
> <= 0.5 6481 5.14 98.86 0.00 4554606 0.13 100.00
> 6862.92
> <= 1 13822 10.97 99.00 0.00 9464128 0.27 99.56
> 1156.87
> <= 2 17600 13.96 99.08 0.00 12514848 0.36 99.54
> 786.20
> <= 5 22413 17.78 99.05 0.00 17677478 0.50 99.60
> 509.43
> <= 10 26148 20.74 99.06 0.00 22395790 0.64 99.67
> 347.62
> <= 20 30106 23.88 99.05 0.00 29293130 0.83 99.73
> 234.72
> <= 50 42705 33.88 82.49 0.01 58353902 1.66 73.61
> 95.95
> <= 100 68510 54.35 59.74 0.04 143179K 4.16 44.78
> 58.25
> <= 200 89370 70.90 49.63 0.06 272172K 7.91 31.18
> 49.93
> <= 500 112600 89.33 41.76 0.11 448183K 13.03 24.95
> 34.62
> <= 1000 121005 96.00 39.30 0.16 590707K 17.17 21.39
> 31.46
> <= 2000 123703 98.14 38.53 0.18 713232K 20.73 20.20
> 31.90
> <= 5000 124946 99.13 38.19 0.21 857564K 24.92 17.74
> 32.80
> <= 10000 125331 99.43 38.08 0.23 1118622K 32.51 13.74
> 38.75
> <= 20000 125545 99.60 38.01 0.25 1394361K 40.53 11.02
> 43.74
> <= 50000 125705 99.73 37.97 0.29 1861301K 54.10 8.26
> 50.69
> <= 100000 125819 99.82 37.94 0.37 2206349K 64.12 6.97
> 47.28
> <= 200000 126017 99.98 37.88 0.59 2804263K 81.50 5.48
> 37.84
> <= 500000 126033 99.99 37.87 0.62 3185421K 92.58 4.83
> 40.55
> <= 1000000 126040 99.99 37.87 0.67 3392516K 98.60 4.53
> 40.44
> <= 1e10 126047 100.00 37.87 0.75 3440715K 100.00 4.47
> 36.17
> ---------------- --------- ------ ------ ------- -------- ------ ------
> -------
> Sum 126047 100.00 37.87 0.75 3440715K 100.00 4.47
> 36.17
>
>
> # UDP Response code distribution
> no matching requests
>
>
> # TCP Response code distribution
> status-code request % Byte
> %
> ---------------------------------------------- --------- ------ --------
> ------
> 000 (Used mostly with UDP traffic) 733 0.58 0
> 0.00
> 200 (OK) 79473 63.05 3408848K
> 99.07
> 204 (No Content) 308 0.24 106962
> 0.00
> 206 (Partial Content) 76 0.06 9424810
> 0.27
> 207 (Multi Status) 6 0.00 7074
> 0.00
> 301 (Moved Permanently) 1025 0.81 695657
> 0.02
> 302 (Moved Temporarily) 5395 4.28 4111776
> 0.12
> 303 (See Other) 239 0.19 120335
> 0.00
> 304 (Not Modified) 33486 26.57 11277324
> 0.32
> 400 (Bad Request) 27 0.02 53199
> 0.00
> 403 (Forbidden) 132 0.10 246752
> 0.01
> 404 (Not Found) 4953 3.93 6333840
> 0.18
> 410 (Gone) 1 0.00 715
> 0.00
> 500 (Internal Server Error) 59 0.05 43854
> 0.00
> 502 (Bad Gateway) 10 0.01 14655
> 0.00
> 503 (Service Unavailable) 84 0.07 117156
> 0.00
> 504 (Gateway Timeout) 39 0.03 62172
> 0.00
> 600 (Squid header parsing error) 1 0.00 15021
> 0.00
> ---------------------------------------------- --------- ------ --------
> ------
> Sum 126047 100.00 3440715K
> 100.00
>
Hi Thomas,
Which OS are you using and which squid version? Are you using 512 MB Ram for cache_mem?
Posting your squid.conf would help to troubleshoot your problems.
Can you also post the statistics of your squidclient info?
squidclient mgr:info
>
>
> Calamaris 2.99.4.0
> Copyright (C) 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006
> Cord Beermann. Authors: Cord Beermann and Michael Pophal.
> Calamaris comes with ABSOLUTELY NO WARRANTY. It is free software, and you are
> welcome to redistribute it under certain conditions. See source for details.
> http://Calamaris.Cord.de/
>
>
>
>
- --
With best regards and good wishes,
Yours sincerely,
Tek Bahadur Limbu
(TAG/TDG Group)
Jwl Systems Department
Worldlink Communications Pvt. Ltd.
Jawalakhel, Nepal
http://www.wlink.com.np
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (FreeBSD)
iD8DBQFGYnbYVrOl+eVhOvYRAggOAKCc5WDJqp61pdFjPnZdoh/kAHHN9gCfeatL
Kay0NcagbAuuKmZLuD5TbWw=
=fS1i
-----END PGP SIGNATURE-----
Received on Sun Jun 03 2007 - 02:08:07 MDT
This archive was generated by hypermail pre-2.1.9 : Sun Jul 01 2007 - 12:00:03 MDT