Re: [squid-users] Squid3 just Died

From: Amos Jeffries <squid3_at_treenet.co.nz>
Date: Thu, 11 Dec 2008 12:27:56 +1300 (NZDT)

> Amos,
>
> I checked all the squid3 directories:
> squid3: /usr/sbin/squid3 /etc/squid3 /usr/lib/squid3 /usr/share/squid3
>
> and didn't find any core.* files. I even did a
>
> /etc/squid3# whereis core
> core: /usr/share/man/man5/core.5.gz
>
> and it didn't find anything significant.
>
> I installed squid3 on debian with apt-get install squid3. Looks like
> debian doesn't have a current version of squid3 other than PRE5. I will
> download it from the website and install it from source.

3.0.STABLE* release package is available from the lenny repositories.

>
> I don't think the logging drive was running out of space because Is a
> pretty big drive and partition. What can other thing make squid act like
> this?

A random segfault is the probable cause. They are most commonly seen when
running out of disk space. But can occur elsewhere.

Amos

>
> Amos Jeffries wrote:
>> Wilson Hernandez - MSD, S. A. wrote:
>>> Pieter,
>>>
>>> I had to delete my cache. I didn't get any answers from the list and I
>>> had a lot of people calling.
>>>
>>> I did:
>>> rm -r /squid/cache/*
>>>
>>> it took over 30 minutes.
>>> Then,
>>> restarted squid (/etc/init.d/squid3 start) and it was doing the same:
>>> It started and it just died without giving any errors.
>>>
>>> I then decided to also delete, actually rename, access.log and
>>> store.log files. This time when I restarted, it worked. I had to do it
>>> that way because that was the only solution I found. I there is
>>> another way to restore all the previous objects please let me know.
>>>
>>> One more thing, What could have caused that problem? Will this happen
>>> again in a couple of months?
>>
>> Hmm, if it was the logging drive running out of space yes it might
>> happen again. Check for core.* files in the squid home directory.
>>
>> Amos
>>
>>>
>>> Thanks
>>>
>>> Pieter De Wit wrote:
>>>> Well - something is killing it. It got a lot future than before, it
>>>> stopped
>>>> at 0.6% iirc last time ?
>>>>
>>>> On Tue, 09 Dec 2008 22:42:52 -0400, "Wilson Hernandez - MSD, S. A."
>>>> <wh_at_msdrd.com> wrote:
>>>>> That i486 thing just might have been the original kernel. I don't
>>>>> know why it says i486.
>>>>>
>>>>> I ran tail -f /var/log/squid/cache.log and noticed that squid tries
>>>>> to rebuild the cache, it stops and restarts again:
>>>>>
>>>>> Store rebuilding is 10.1% complete
>>>>>
>>>>> I don't want to delete my cache. That's the only solutions I've
>>>>> found on the internet:
>>>>>
>>>>> 1) Shutdown your squid server
>>>>> squid -k shutdown
>>>>>
>>>>> 2) Remove the cache directory
>>>>> rm -r /squid/cache/*
>>>>>
>>>>> 3) Re-Create the squid cache directory
>>>>> squid -z
>>>>>
>>>>> 4) Start the squid
>>>>>
>>>>> My cache is pretty big and it would take a while to delete all the
>>>>> stuff in there. Also, I will loose all that data from months of
>>>>> objects...
>>>>>
>>>>> Pieter De Wit wrote:
>>>>>> Hi,
>>>>>>
>>>>>> Might be totally off here, but I noted your swap size is "large".
>>>>>> Could
>>>>> it
>>>>>> be that the cache has more objects (in count and in byte count ?)
>>>>>> than
>>>>> can
>>>>>> fit into a 32-bit counter ?
>>>>>>
>>>>>> I got to this by seeing that it crashes at the cache rebuild
>>>>>> section as
>>>>>> well as the fact the the build is i486.
>>>>>>
>>>>>> Like I said, might be *way* off but hey :)
>>>>>>
>>>>>> Cheers,
>>>>>>
>>>>>> Pieter
>>>>>>
>>>>>> On Tue, 09 Dec 2008 19:04:54 -0700, wh_at_msdrd.com wrote:
>>>>>>> Hello.
>>>>>>>
>>>>>>> I came across something weird. Squid3 just stopped working, just
>>>>>>> dies
>>>>>>> without any error message. My server was running as usual and all
>>>>>>> over
>>>>> a
>>>>>>> sudden users weren't getting internet. I checked if all the normal
>>>>>>> processes were running and noticed squid wasn't. Now, I try to
>>>>>>> start
>>>>> the
>>>>>>> server and it starts and dies after a few seconds. Heres part of
>>>>>>> the
>>>>>>> cache.log file:
>>>>>>>
>>>>>>> 2008/12/09 22:03:07| Starting Squid Cache version 3.0.PRE5 for
>>>>>>> i486-pc-linux-gnu...
>>>>>>> 2008/12/09 22:03:07| Process ID 4063
>>>>>>> 2008/12/09 22:03:07| With 1024 file descriptors available
>>>>>>> 2008/12/09 22:03:07| DNS Socket created at 0.0.0.0, port 33054, FD
>>>>>>> 8
>>>>>>> 2008/12/09 22:03:07| Adding nameserver 200.42.213.11 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:07| Adding nameserver 200.42.213.21 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:07| Unlinkd pipe opened on FD 13
>>>>>>> 2008/12/09 22:03:07| Swap maxSize 102400000 KB, estimated 7876923
>>>>>>> objects
>>>>>>> 2008/12/09 22:03:07| Target number of buckets: 393846
>>>>>>> 2008/12/09 22:03:07| Using 524288 Store buckets
>>>>>>> 2008/12/09 22:03:07| Max Mem size: 102400 KB
>>>>>>> 2008/12/09 22:03:07| Max Swap size: 102400000 KB
>>>>>>> 2008/12/09 22:03:07| Rebuilding storage in /var/log/squid/cache
>>>>>>> (DIRTY)
>>>>>>> 2008/12/09 22:03:07| Using Least Load store dir selection
>>>>>>> 2008/12/09 22:03:07| Current Directory is /
>>>>>>> 2008/12/09 22:03:07| Loaded Icons.
>>>>>>> 2008/12/09 22:03:07| Accepting transparently proxied HTTP
>>>>>>> connections
>>>>> at
>>>>>>> 192.168.2.1, port 3128, FD 15.
>>>>>>> 2008/12/09 22:03:07| HTCP Disabled.
>>>>>>> 2008/12/09 22:03:07| WCCP Disabled.
>>>>>>> 2008/12/09 22:03:07| Ready to serve requests.
>>>>>>> 2008/12/09 22:03:11| Starting Squid Cache version 3.0.PRE5 for
>>>>>>> i486-pc-linux-gnu...
>>>>>>> 2008/12/09 22:03:11| Process ID 4066
>>>>>>> 2008/12/09 22:03:11| With 1024 file descriptors available
>>>>>>> 2008/12/09 22:03:11| DNS Socket created at 0.0.0.0, port 33054, FD
>>>>>>> 8
>>>>>>> 2008/12/09 22:03:11| Adding nameserver 200.42.213.11 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:11| Adding nameserver 200.42.213.21 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:11| Unlinkd pipe opened on FD 13
>>>>>>> 2008/12/09 22:03:11| Swap maxSize 102400000 KB, estimated 7876923
>>>>>>> objects
>>>>>>> 2008/12/09 22:03:11| Target number of buckets: 393846
>>>>>>> 2008/12/09 22:03:11| Using 524288 Store buckets
>>>>>>> 2008/12/09 22:03:11| Max Mem size: 102400 KB
>>>>>>> 2008/12/09 22:03:11| Max Swap size: 102400000 KB
>>>>>>> 2008/12/09 22:03:11| Rebuilding storage in /var/log/squid/cache
>>>>>>> (DIRTY)
>>>>>>> 2008/12/09 22:03:11| Using Least Load store dir selection
>>>>>>> 2008/12/09 22:03:11| Current Directory is /
>>>>>>> 2008/12/09 22:03:11| Loaded Icons.
>>>>>>> 2008/12/09 22:03:11| Accepting transparently proxied HTTP
>>>>>>> connections
>>>>> at
>>>>>>> 192.168.2.1, port 3128, FD 15.
>>>>>>> 2008/12/09 22:03:11| HTCP Disabled.
>>>>>>> 2008/12/09 22:03:11| WCCP Disabled.
>>>>>>> 2008/12/09 22:03:11| Ready to serve requests.
>>>>>>> 2008/12/09 22:03:12| Store rebuilding is 0.6% complete
>>>>>>> 2008/12/09 22:03:17| Starting Squid Cache version 3.0.PRE5 for
>>>>>>> i486-pc-linux-gnu...
>>>>>>> 2008/12/09 22:03:17| Process ID 4069
>>>>>>> 2008/12/09 22:03:17| With 1024 file descriptors available
>>>>>>> 2008/12/09 22:03:17| DNS Socket created at 0.0.0.0, port 33054, FD
>>>>>>> 8
>>>>>>> 2008/12/09 22:03:17| Adding nameserver 200.42.213.11 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:17| Adding nameserver 200.42.213.21 from
>>>>>>> squid.conf
>>>>>>> 2008/12/09 22:03:17| Unlinkd pipe opened on FD 13
>>>>>>> 2008/12/09 22:03:17| Swap maxSize 102400000 KB, estimated 7876923
>>>>>>> objects
>>>>>>> 2008/12/09 22:03:17| Target number of buckets: 393846
>>>>>>> 2008/12/09 22:03:17| Using 524288 Store buckets
>>>>>>> 2008/12/09 22:03:17| Max Mem size: 102400 KB
>>>>>>> 2008/12/09 22:03:17| Max Swap size: 102400000 KB
>>>>>>> 2008/12/09 22:03:17| Rebuilding storage in /var/log/squid/cache
>>>>>>> (DIRTY)
>>>>>>> 2008/12/09 22:03:17| Using Least Load store dir selection
>>>>>>> 2008/12/09 22:03:17| Current Directory is /
>>>>>>> 2008/12/09 22:03:17| Loaded Icons.
>>>>>>> 2008/12/09 22:03:17| Accepting transparently proxied HTTP
>>>>>>> connections
>>>>> at
>>>>>>> 192.168.2.1, port 3128, FD 15.
>>>>>>> 2008/12/09 22:03:17| HTCP Disabled.
>>>>>>> 2008/12/09 22:03:17| WCCP Disabled.
>>>>>>> 2008/12/09 22:03:17| Ready to serve requests.
>>>>>>> 2008/12/09 22:03:18| Store rebuilding is 0.6% complete
>>>>>>>
>>>>>>>
>>>>>>> Please help. Your help will be appreciated.
>>>>>>>
>>>>>>> Thank you in advanced.
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>
>>
>>
>
> --
> *Wilson Hernandez*
> Presidente
> 829.848.9595
> 809.766.0441
> www.msdrd.com <http://www.msdrd.com>
> Conservando el medio ambiente
>
Received on Wed Dec 10 2008 - 23:28:00 MST

This archive was generated by hypermail 2.2.0 : Thu Dec 11 2008 - 12:00:02 MST