RE: [squid-users] CPU utilization performance issue

Hi,
I am just wonder why you are not using diskd.
Based on Benchmarking that I read, diskd provides faster I/O performance.
I am planning to run squid on Linux Redhat 9.0 and thinking to use ext3 and diskd.
Thanks,
Nooshin

-----Original Message-----
From: Tay Teck Wee [mailto:wolfpacks01@yahoo.com.sg]
Sent: Friday, August 08, 2003 2:22 AM
To: squid-users
Subject: Re: [squid-users] CPU utilization performance issue

Hi everyone,

thanks for the input. The ACL list have since been
slightly altered, using only src(22 entries),
dstdomain(114 entries) and url_regex(20 entries). I am
currently on kernel 2.4.20-19.9 so the Hyperthreading
might hv been optimized.

Now the machine is handling about 110 req/s but again
the CPU will climb to abt 90-95%. Is it possible for
my squid box to go beyond 180 req/s, which is the peak
for each proxies in the existing pool(ISP env)? I am
trying to replace my existing NetCaches with
squids...one box for one box.

I am wondering if its because reiserfs will consume
more CPU than other fs like ext3? Will changing my
cache partitions to reiserf lower down the CPU usage?
Or can anyone suggest other possible improvements?
Thanks.

my 3 caching partitions are on 3 separate disks:-
/dev/sdb1 /cdata1 reiserfs notail,noatime 1 2
/dev/sdc1 /cdata2 reiserfs notail,noatime 1 2
/dev/sdd1 /cdata3 reiserfs notail,noatime 1 2

--
Wolf
 --- Tay Teck Wee <wolfpacks01@yahoo.com.sg> wrote: >
Hi,
> 
> when I'm getting about 90 req/s or 800 concurrent
> connection(according to my foundry L4) to my
> squid(RedHat 8.0/2.5 Stable3 w deny_info patch), the
> CPU utilization avg abt 80%. How do I lower the CPU
> utilization of my squid? Thanks.  
> 
> Below is my machine specs:-
> 
> Intel Xeon single-processor 2.4GHz(DELL 2650)
> 2G physical RAM(w 2G swap under linux)
> 2X 33G for everything except caching (mirror)
> 3X 33G for caching (volume) 
> 
> /dev/sda7               505605     68437    411064 
> 15% /
> /dev/sda1               124427      9454    108549  
> 9% /boot
> /dev/sdb1             35542688    201248  35341440  
> 1% /cdata1
> /dev/sdc1             35542688    200888  35341800  
> 1% /cdata2
> /dev/sdd1             35542688    200940  35341748  
> 1% /cdata3
> /dev/sda3              1035692     49796    933284  
> 6% /home
> none                   1032588         0   1032588  
> 0% /dev/shm
> /dev/sda5              1035660    691648    291404 
> 71% /usr
> /dev/sda6               505605     76236    403265 
> 16% /usr/local
> /dev/sda8             29695892     83456  28103936  
> 1% /var
> 
> Below is my squid.conf(only the essential). 
> 
> For ACL, basically I hv 3 acl list(in 3 separate
> files), one containing allowable IPs while the other
> contains deny IPs. I also hv 3 list of banned sites
> list(in 3 separate files).:-
> 
> http_port 8080
> acl QUERY urlpath_regex cgi-bin \?
> no_cache deny QUERY
> cache_mem 400 MB
> cache_swap_low 92
> cache_swap_high 95
> maximum_object_size 2 MB
> maximum_object_size_in_memory 100 KB
> cache_replacement_policy heap GDSF
> memory_replacement_policy heap GDSF
> cache_dir aufs /cdata1 16000 36 256
> cache_dir aufs /cdata2 16000 36 256
> cache_dir aufs /cdata3 16000 36 256
> cache_access_log /var/log/cachelog/cache.access.log
> cache_log /var/log/cachelog/cache.log
> cache_store_log none
> quick_abort_min -1 KB
> acl all src 0.0.0.0/0.0.0.0
> acl manager proto cache_object
> acl localhost src 127.0.0.1/255.255.255.255
> #3 banned list files
> acl SBA dstdomain "/usr/local/squid/etc/SBA.txt"
> acl CNB dstdomain "/usr/local/squid/etc/CNB.txt"
> acl CNB2 url_regex "/usr/local/squid/etc/CNB2.txt"
> #3 access list files
> acl NetTP src "/usr/local/squid/etc/NetTPsrc.acl"
> acl NetDeny src "/usr/local/squid/etc/deny.acl"
> acl NetAllow src "/usr/local/squid/etc/allow.acl"
> http_access deny SBA
> http_access deny CNB
> http_access deny CNB2
> http_access deny NetDeny
> http_access allow NetAllow
> http_access allow NetTP
> http_access deny all
> http_reply_access allow all
> cache_effective_user squid
> cache_effective_group squid
> logfile_rotate 10
> deny_info ERR_SBA_DENIED SBA
> deny_info ERR_CNB_DENIED CNB CNB2
> memory_pools off
> coredump_dir /var/log/cachelog
> 
> Thanks again!
> 
> Regards,
> Wolf
> 
> 
> __________________________________________________
> Do You Yahoo!?
> Send free SMS from your PC!
> http://sg.sms.yahoo.com 
__________________________________________________
Do You Yahoo!?
Send free SMS from your PC!
http://sg.sms.yahoo.com