Re: [squid-users] squid deletes cache_dir objects randomly - is there no solution?

On Wednesday 16 November 2005 11:29, Henrik Nordstrom wrote:
> On Wed, 16 Nov 2005, H wrote:
> > on the servers I do not log at all so I am sorry about not having
> > anything more usefull since the server itself and the squid process did
> > not die I didn't get a trap either to look in time
>
> So it is entirely possible the Squid process restarted itself for some
> reason, loosing it's swap.state content in the process (double crash)?
>

so look what I got after a powerloss

squid started with dirty cache_dirs and after it restarted indeed itself and
came up with another cache object count and started cleaning the cache_dir

unfortunatly on this machine I do not have cache_log enabled :(

do this help in any way?

Dec 12 22:38:30 cache squid[1707]: Rebuilding storage in /cache/c2 (DIRTY)
Dec 12 22:38:31 cache squid[1707]: Rebuilding storage in /cache/c1 (DIRTY)
Dec 12 22:38:31 cache squid[1707]: Using Least Load store dir selection
Dec 12 22:38:31 cache squid[1707]: Current Directory is /
Dec 12 22:38:31 cache squid[1707]: Loaded Icons.
Dec 12 22:38:31 cache squid[1707]: Accepting HTTP connections at
200.252.146.9, port 8080, FD 13.
Dec 12 22:38:31 cache squid[1707]: Accepting HTTP connections at
200.252.146.65, port 8080, FD 15.
Dec 12 22:38:31 cache squid[1707]: Accepting HTTP connections at
200.252.22.129, port 8080, FD 16.
Dec 12 22:38:31 cache squid[1707]: Accepting HTTP connections at
200.252.22.161, port 8080, FD 17.
Dec 12 22:38:31 cache squid[1707]: Accepting HTTP connections at 127.0.0.1,
port 8080, FD 18.
Dec 12 22:38:31 cache squid[1707]: WCCP Disabled.
Dec 12 22:38:31 cache squid[1707]: Ready to serve requests.
Dec 12 22:38:32 cache squid[1707]: Reconfiguring Squid Cache (version
2.5.STABLE12-20051130)...
Dec 12 22:38:32 cache squid[1707]: FD 13 Closing HTTP connection
Dec 12 22:38:32 cache squid[1707]: FD 15 Closing HTTP connection
Dec 12 22:38:32 cache squid[1707]: FD 16 Closing HTTP connection
Dec 12 22:38:32 cache squid[1707]: FD 17 Closing HTTP connection
Dec 12 22:38:32 cache squid[1707]: FD 18 Closing HTTP connection
Dec 12 22:38:32 cache squid[1707]: Cache dir '/cache/c2' size remains
unchanged at 15360000 KB
Dec 12 22:38:32 cache squid[1707]: Cache dir '/cache/c1' size remains
unchanged at 15360000 KB
Dec 12 22:38:32 cache squid[1707]: Store logging disabled
Dec 12 22:38:32 cache squid[1707]: DNS Socket created at 0.0.0.0, port 50754,
FD 5
Dec 12 22:38:32 cache squid[1707]: Adding nameserver 127.0.0.1
from /etc/resolv.conf
Dec 12 22:38:32 cache squid[1707]: Accepting HTTP connections at
200.252.146.9, port 8080, FD 7.
Dec 12 22:38:32 cache squid[1707]: Accepting HTTP connections at
200.252.146.65, port 8080, FD 10.
Dec 12 22:38:32 cache squid[1707]: Accepting HTTP connections at
200.252.22.129, port 8080, FD 13.
Dec 12 22:38:32 cache squid[1707]: Accepting HTTP connections at
200.252.22.161, port 8080, FD 15.
Dec 12 22:38:32 cache squid[1707]: Accepting HTTP connections at 127.0.0.1,
port 8080, FD 16.
Dec 12 22:38:32 cache squid[1707]: WCCP Disabled.
Dec 12 22:38:32 cache squid[1707]: Loaded Icons.
Dec 12 22:38:32 cache squid[1707]: eventCleanup
Dec 12 22:38:32 cache squid[1707]: Ready to serve requests.
Dec 12 22:38:32 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00000D10
Dec 12 22:38:33 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0000BEE9
Dec 12 22:38:34 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000132EA
Dec 12 22:38:34 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0001380B
Dec 12 22:38:34 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000164B0
Dec 12 22:38:34 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00018A25
Dec 12 22:38:34 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00018FD5
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 00010343
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0001AEB1
Dec 12 22:38:35 cache squid[1707]: Store rebuilding is 12.9% complete
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00020420
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000205A1
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000209EB
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000220F5
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000221B7
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000221D0
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0002228E
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00022298
Dec 12 22:38:35 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00022607
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00023D9F
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000241BE
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00024D81
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000254B5
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00026894
Dec 12 22:38:36 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 00020BCC
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 00021188
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00029213
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00033FB1
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00036382
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00036904
Dec 12 22:38:37 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 00039808
Dec 12 22:38:38 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0003E3F1
Dec 12 22:38:38 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0003FDA5
Dec 12 22:38:38 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000429CE
Dec 12 22:38:38 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000285A3
Dec 12 22:38:39 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0004C5E4
Dec 12 22:38:39 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0002AFCA
Dec 12 22:38:39 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0002EAED
Dec 12 22:38:39 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0002EDB7
Dec 12 22:38:39 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000688EF
Dec 12 22:38:40 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0006C783
Dec 12 22:38:40 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0007F0CE
Dec 12 22:38:41 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000848ED
Dec 12 22:38:41 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0008904C
Dec 12 22:38:42 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 00045E75
Dec 12 22:38:42 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 0009B0AE
Dec 12 22:38:42 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000464A5
Dec 12 22:38:42 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0004B0CE
Dec 12 22:38:42 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0004BEA6
Dec 12 22:38:44 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000D5870
Dec 12 22:38:45 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000EF0D1
Dec 12 22:38:46 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000F808E
Dec 12 22:38:46 cache squid[1707]: WARNING: newer swaplog entry for dirno 0,
fileno 000FCCE1
Dec 12 22:38:47 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000BA5FC
Dec 12 22:38:47 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000D0632
Dec 12 22:38:47 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000D0C11
Dec 12 22:38:47 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 000D944F
Dec 12 22:38:48 cache squid[1707]: WARNING: newer swaplog entry for dirno 1,
fileno 0000BF3B
Dec 12 22:38:48 cache squid[1707]: Done reading /cache/c2 swaplog (105098
entries)
Dec 12 22:38:48 cache squid[1707]: Done reading /cache/c1 swaplog (123153
entries)
Dec 12 22:38:48 cache squid[1707]: Finished rebuilding storage from disk.
Dec 12 22:38:48 cache squid[1707]: 141402 Entries scanned
Dec 12 22:38:48 cache squid[1707]: 0 Invalid entries.
Dec 12 22:38:48 cache squid[1707]: 0 With invalid flags.
Dec 12 22:38:48 cache squid[1707]: 65720 Objects loaded.
Dec 12 22:38:48 cache squid[1707]: 0 Objects expired.
Dec 12 22:38:48 cache squid[1707]: 3439 Objects cancelled.
Dec 12 22:38:48 cache squid[1707]: 10496 Duplicate URLs purged.
Dec 12 22:38:48 cache squid[1707]: 64888 Swapfile clashes avoided.
Dec 12 22:38:48 cache squid[1707]: Took 20.5 seconds (3213.0 objects/sec).
Dec 12 22:38:48 cache squid[1707]: Beginning Validation Procedure
Dec 12 22:38:48 cache squid[1707]: Completed Validation Procedure
Dec 12 22:38:48 cache squid[1707]: Validated 62558 Entries
Dec 12 22:38:48 cache squid[1707]: store_swap_size = 679946k
Dec 12 22:38:49 cache squid[1707]: storeLateRelease: released 0 objects
Dec 12 22:39:06 cache squid[1707]: Preparing for shutdown after 62 requests
Dec 12 22:39:06 cache squid[1707]: Waiting 30 seconds for active connections
to finish
Dec 12 22:39:06 cache squid[1707]: FD 7 Closing HTTP connection
Dec 12 22:39:06 cache squid[1707]: FD 10 Closing HTTP connection
Dec 12 22:39:06 cache squid[1707]: FD 13 Closing HTTP connection
Dec 12 22:39:06 cache squid[1707]: FD 15 Closing HTTP connection
Dec 12 22:39:06 cache squid[1707]: FD 16 Closing HTTP connection
Dec 12 22:39:37 cache squid[1707]: Shutting down...
Dec 12 22:39:37 cache squid[1707]: Closing unlinkd pipe on FD 9
Dec 12 22:39:37 cache squid[1707]: storeDirWriteCleanLogs: Starting...
Dec 12 22:39:37 cache squid[1707]: Finished. Wrote 62573 entries.
Dec 12 22:39:37 cache squid[1707]: Took 0.1 seconds (938435.5 entries/sec).
Dec 12 22:39:37 cache squid[1707]: Open FD 11 squid -> diskd
Dec 12 22:39:37 cache squid[1707]: Open FD 14 squid -> diskd
Dec 12 22:39:37 cache squid[1707]: Squid Cache (Version
2.5.STABLE12-20051130): Exiting normally.
Dec 12 22:41:03 cache squid[1693]: WARNING: Closing open FD 2
Dec 12 22:41:03 cache squid[1693]: Starting Squid Cache version
2.5.STABLE12-20051130 for i386-unknown-freebsd5.4...
Dec 12 22:41:03 cache squid[1693]: Process ID 1693
Dec 12 22:41:03 cache squid[1693]: With 7360 file descriptors available
Dec 12 22:41:03 cache squid[1693]: Performing DNS Tests...
Dec 12 22:41:03 cache squid[1693]: Successful DNS name lookup tests...
Dec 12 22:41:03 cache squid[1693]: DNS Socket created at 0.0.0.0, port 63879,
FD 4
Dec 12 22:41:03 cache squid[1693]: Adding nameserver 127.0.0.1
from /etc/resolv.conf
Dec 12 22:41:04 cache squid[1693]: Unlinkd pipe opened on FD 9
Dec 12 22:41:04 cache squid[1693]: Swap maxSize 30720000 KB, estimated 2363076
objects
Dec 12 22:41:04 cache squid[1693]: Target number of buckets: 118153
Dec 12 22:41:04 cache squid[1693]: Using 131072 Store buckets
Dec 12 22:41:04 cache squid[1693]: Max Mem size: 200704 KB
Dec 12 22:41:04 cache squid[1693]: Max Swap size: 30720000 KB
Dec 12 22:41:04 cache squid[1693]: Store logging disabled
Dec 12 22:41:05 cache squid[1693]: Rebuilding storage in /cache/c2 (CLEAN)
Dec 12 22:41:06 cache squid[1693]: Rebuilding storage in /cache/c1 (CLEAN)
Dec 12 22:41:06 cache squid[1693]: Using Least Load store dir selection
Dec 12 22:41:06 cache squid[1693]: Current Directory is /
Dec 12 22:41:06 cache squid[1693]: Loaded Icons.
Dec 12 22:41:06 cache squid[1693]: Accepting HTTP connections at
200.252.146.9, port 8080, FD 13.
Dec 12 22:41:06 cache squid[1693]: Accepting HTTP connections at
200.252.146.65, port 8080, FD 15.
Dec 12 22:41:06 cache squid[1693]: Accepting HTTP connections at
200.252.22.129, port 8080, FD 16.
Dec 12 22:41:06 cache squid[1693]: Accepting HTTP connections at
200.252.22.161, port 8080, FD 17.
Dec 12 22:41:06 cache squid[1693]: Accepting HTTP connections at 127.0.0.1,
port 8080, FD 18.
Dec 12 22:41:06 cache squid[1693]: WCCP Disabled.
Dec 12 22:41:06 cache squid[1693]: Ready to serve requests.
Dec 12 22:41:09 cache squid[1693]: Store rebuilding is 14.4% complete
Dec 12 22:41:20 cache squid[1693]: Done reading /cache/c2 swaplog (28403
entries)
Dec 12 22:41:22 cache squid[1693]: Done reading /cache/c1 swaplog (34170
entries)
Dec 12 22:41:22 cache squid[1693]: Finished rebuilding storage from disk.
Dec 12 22:41:22 cache squid[1693]: 62573 Entries scanned
Dec 12 22:41:22 cache squid[1693]: 0 Invalid entries.
Dec 12 22:41:22 cache squid[1693]: 0 With invalid flags.
Dec 12 22:41:22 cache squid[1693]: 62571 Objects loaded.
Dec 12 22:41:22 cache squid[1693]: 0 Objects expired.
Dec 12 22:41:22 cache squid[1693]: 0 Objects cancelled.
Dec 12 22:41:22 cache squid[1693]: 1 Duplicate URLs purged.
Dec 12 22:41:22 cache squid[1693]: 1 Swapfile clashes avoided.
Dec 12 22:41:22 cache squid[1693]: Took 18.4 seconds (3403.5 objects/sec).
Dec 12 22:41:22 cache squid[1693]: Beginning Validation Procedure
Dec 12 22:41:22 cache squid[1693]: Completed Validation Procedure
Dec 12 22:41:22 cache squid[1693]: Validated 62571 Entries
Dec 12 22:41:22 cache squid[1693]: store_swap_size = 679984k
Dec 12 22:41:22 cache squid[1693]: storeLateRelease: released 0 objects

-- 
H.
A mensagem foi scaneada pelo sistema de e-mail e pode ser considerada segura.
Service fornecido pelo Datacenter Matik  https://datacenter.matik.com.br