Re: [squid-users] Squid performance with high load

On Sun, Mar 31, 2013 at 3:20 AM, Amos Jeffries <squid3_at_treenet.co.nz> wrote:
> On 31/03/2013 9:07 a.m., Hasanen AL-Bana wrote:
>>
>> The above config for cache_dirs is not working probably.
>
>
> You are top-posting.
> . Why?
> .. There is no "above config".
Sorry , it is the new gmail composer...

>
>
>> I can see the aufs dir growing rapidly while the Rock directory has
>> been created but it is empty !
>>
>>
>> -------------------------------------------------------------------------------
>> Store Directory Statistics:
>> Store Entries : 1166040
>> Maximum Swap Size : 1740800000 KB
>> Current Store Swap Size: 85456552.00 KB
>> Current Capacity : 4.91% used, 95.09% free
>>
>> Store Directory #0 (rock): /mnt/ssd/cache/
>> FS Block Size 1024 Bytes
>>
>> Maximum Size: 307200000 KB
>> Current Size: 760592.00 KB 0.25%
>> Maximum entries: 2399999
>> Current entries: 5942 0.25%
>> Pending operations: 137 out of 0
>> Flags:
>>
>> Store Directory #1 (aufs): /mnt/sas1/cache/store1
>> FS Block Size 4096 Bytes
>> First level subdirectories: 32
>> Second level subdirectories: 512
>> Maximum Size: 1433600000 KB
>> Current Size: 84695960.00 KB
>> Percent Used: 5.91%
>> Filemap bits in use: 1159378 of 2097152 (55%)
>> Filesystem Space in use: 121538556/-1957361748 KB (-5%)
>> Filesystem Inodes in use: 1176103/146243584 (1%)
>> Flags:
>> Removal policy: lru
>> LRU reference age: 0.17 days
>>
>> On Sat, Mar 30, 2013 at 5:10 PM, Hasanen AL-Bana <hasanen_at_gmail.com>
>> wrote:
>>>
>>> Thank you Amos for clarifying these issues.
>>> I will skip SMP and use single worker since Rock limit my max object
>>> size to 32kb when used in shared environments.
>>> My new cache_dir configuration looks like this now :
>>>
>>> cache_dir rock /mnt/ssd/cache/ 300000 max-size=131072
>>> cache_dir aufs /mnt/sas1/cache/store1 1400000 32 512
>
>
> NP: Rock is a 'slot'-based database format and does not support objects
> larger than 32KB, unless you are using the experimental large-rock code.
> max-size will be capped down to max-size=32767. You should have seen a
> warning about that when starting or reconfiguring Squid.
>
> To prevent the AUFS dir filling wil small objects that can best be served
> from Rock, you will also need min-size= parameter on the AUFS. Otherwise
> Squid will base selection on capacity loading and will determine that the
> 1.4TB dir has more free space than the 300GB Rock one.
>

Ok , according to the Wiki at
http://wiki.squid-cache.org/Features/RockStore , the max size is
limited to 32kb if I work in shared environment. I have only one
worker now and my rock max-size is set to 131072.
To make it work , I had to change my cache_dir selection algorithm to
round-robin.

>
>
>>> I have enabled store.log to be used with some other software
>>> collecting data from it
>>>
>>> my disks are now mounted with
>>>
>>> noatime,barrier=0,journal_async_commit,noauto_da_alloc,nobh,data=writeback,commit=10
>>>
>>> I will keep the list posted with my results.
>>> Thanks.
>
>
> Amos
Received on Sun Mar 31 2013 - 09:17:05 MDT