[squid-users] storage rebuild slow with reiserfs

From: Martin Marji Cermak <mc1@dont-contact.us>
Date: Tue, 01 Feb 2005 17:54:16 +0800

Hello,
I have two 36 GB, 10 rpm scsi disk dedicated to Squid.2.5.STABLE7.
No raid.Adaptec 29320LP Ultra320 SCSI adapter, SEAGATE ST336607LW

cache_dir aufs /cache/cache1 28000 60 256
cache_dir aufs /cache/cache2 28000 60 256

When I had these disks formated with ext3, Squid store rebuild took
maximaly 2 minutes.

Last Friday I changed the filesystem to reiserfs. I did not want to
loose the cache content so I added an identical disk, formated it with
reiserfs, copied one entire cache2 to the new disk:
  `cp -p -r cache2/* cache2new/` to the new disk,
reformated the cache2 disk with reiserfs and copied there the content of
cache1 to cache2 disk and removed the cache1 disk.
(so, one disk was replaced, but there are two disks with reiserfs and
original cache content).

Since I did this operation, Squid takes more than 10 minutes to start,
as shown bellow.

I also see Squid with state "D", e.g.
   358 squid 19 0 1474M 1.4G 1392 D 26.3 41.6 35:30 squid
which is something I hadn't seeen with ext3.
(D = uninterruptible sleep (usually IO))

Can reiserfs be so significanlty slower than ext3 (which took 2 minutes
to start)?

Thank you,
Marji

2005/02/01 15:58:14| Rebuilding storage in /cache/cache1 (CLEAN)
2005/02/01 15:58:14| Rebuilding storage in /cache/cache2 (CLEAN)
2005/02/01 15:58:14| Using Least Load store dir selection
2005/02/01 15:58:14| Set Current Directory to /cache
2005/02/01 15:58:14| Loaded Icons.
2005/02/01 15:58:14| Accepting HTTP connections at 0.0.0.0, port 3128,
FD 12.
2005/02/01 15:58:14| Accepting SNMP messages on port 3401, FD 13.
2005/02/01 15:58:14| WCCP Disabled.
2005/02/01 15:58:14| wccp2ConnectionOpen: Accepting WCCPv2 messages on
port 2048, FD 14.
2005/02/01 15:58:14| Ready to serve requests.
2005/02/01 15:58:16| Store rebuilding is 0.3% complete
2005/02/01 16:12:38| Done reading /cache/cache2 swaplog (1472203 entries)
2005/02/01 16:12:38| Done reading /cache/cache1 swaplog (1501404 entries)
2005/02/01 16:12:38| Finished rebuilding storage from disk.
2005/02/01 16:12:38| 2973607 Entries scanned
2005/02/01 16:12:38| 0 Invalid entries.
2005/02/01 16:12:38| 0 With invalid flags.
2005/02/01 16:12:38| 2973607 Objects loaded.
2005/02/01 16:12:38| 0 Objects expired.
2005/02/01 16:12:38| 0 Objects cancelled.
2005/02/01 16:12:38| 0 Duplicate URLs purged.
2005/02/01 16:12:38| 0 Swapfile clashes avoided.
2005/02/01 16:12:38| Took 864.1 seconds (3441.4 objects/sec).
Received on Tue Feb 01 2005 - 02:53:33 MST

This archive was generated by hypermail pre-2.1.9 : Tue Mar 01 2005 - 12:00:01 MST