Re: [squid-users] Reg: Migration of squid cache

Your reply is definitely helpful in re-configuring the new proxy server.
But I am more interested in the correct way of migrating/copying cache
Will a simple rsync -vertp --partial --progress /var/squid/cache1/* <dst> do?
What are the remaining steps? Will there be any permissions issue?
What if those copied files just stay there and not be used?

On Thu, Aug 29, 2013 at 3:30 AM, Eliezer Croitoru <eliezer_at_ngtech.co.il> wrote:
> On 08/29/2013 12:42 AM, Nehal J Wani wrote:
>> On Thu, Aug 29, 2013 at 3:01 AM, Eliezer Croitoru <eliezer_at_ngtech.co.il> wrote:
>>> On 08/29/2013 12:07 AM, Nehal J Wani wrote:
>>>> On Thu, Aug 29, 2013 at 2:32 AM, Eliezer Croitoru <eliezer_at_ngtech.co.il> wrote:
>>>>> On 08/28/2013 11:16 PM, Nehal J Wani wrote:
>>>>>> I am using CentOS 6.4 and want to set up a new proxy server using
>>>>>> squid. Can anybody help me with the steps to be followed for migrating
>>>>>> cache?
>>>>>>
>>>>> What do you have now?
>>>>> What do you aim for??
>>>>> I have compiled new versions of squid for CentOS which is kind of an
>>>>> upgrade to the current squid package that do exist.
>>>>
>>>> Oh no. I am using standard packages. Both are squid 3.1.10
>>>>
>>> OK
>>>>> did you ever used squid before??
>>>>
>>>> Basically, I have to reconfigure the old server to add new partitions
>>>> for extra space for logs and cache.
>>>> Hence. temporarily, I am shifting to a new proxy. Therefore, I need to
>>>> migrate the proxy cache.
>>> OK so if you do have a new server then it depends on the load of the
>>> server but if it's more then a basic server use a dedicated disk for
>>> squid logs...
>>> for many admins these logs are important so a raid volume\disk will
>>> might be better.
>>> LVM can ensure you the option to extend the size of the partition in a
>>> case of a loaded server.
>>>
>>> For the cache_dir it's another story since there is a limit for the size
>>> by the ram etc.
>>> Can you share the current proxy specs and squid.conf??
>>> you can strip down the confidential info and I will try my best to
>>> understand and help you if I can..
>>>
>>> Eliezer
>>
>>
>> I haven't migrated the cache completely as of yet. While copying the
>> cache2 directory from old server,
>> the RAID5 partition committed suicide. I have attached the output of
>> fpaste --sysinfo.
>>
>>
>>
> OK this is pretty understandable..
> it seems to me like more then just a small cache but I might be wrong...
> there is a basic calculation of RAM VS DISK cache.
> I dont remember now the calculation but I do remeber it's a FAQ.
> take a peek at:
> http://wiki.squid-cache.org/SquidFaq/ConfiguringSquid#What_.27.27cache_dir.27.27_size_should_I_use.3F
>
> There is the question and calculation of how much RAM you can use..
> The CPU is not an issue but squid DB which is residing in RAM takes up
> space per number of objects.
> I do Hope that AMOS later on will respond with the right calculation.
> This is the right time to actually write a small script that will help
> linux users calculate it.
> There is a windows squidcalc if i'm right Program that can instruct you
> how to configure the cache_dir size.
> By the way take into account that the proxy might have been configured
> wrongly for a very long period of time and this is indeed a good time to
> tweak the right settings.
> Yet I have seen the squid.conf so I was only referring to what I have
> understood from the plain system info.
>
> Eliezer
>
>
>

-- 
Nehal J Wani
UG3, BTech CS+MS(CL)
IIIT-Hyderabad
http://commandlinewani.blogspot.com