[squid-users] Squid with Tproxy

From: trasor <trasor_at_lhtot.com>
Date: Wed, 15 Apr 2009 04:55:12 -0400

Running squid with tproxy I am seeing entries in the cache log of
'commBind: cannot bind to socket FD # to x.x.x.ip: (22) Invalid
argument'. This is followed by a 'Warning: Reset of FD # for x.x.x.ip
failed to bind: (22) Invalid argument'. From reading, this may be
related to an end user using ftp and as such should be ok just a
nuisance in the cache log. However, I am also seeing 'assertion failed:
MemBuf .cc:388: "new_cap > (size_t) capacity"' whereby squid immediately
restarts initialization and once initialized I start seeing the same
'commBind' entries. I understand these 'commBind' entries are occurring
because squid has reinitialized and are no longer bond to the associated
connections. My server has 16GB of ram and the swap is not being
touched so I am not following why the 'new_cap is greater than size_t
capacity'. There are also occasions where after the assertion failure
occurs, squid does not restart on its own.

Another issue is dealing with Norton LiveUpdate and http1.1 Looking
thru the forums I see the fix is to place http11 after the http_port,
i.e. 'http_port 3129 tproxy http11'. But according to the change log
that function has not been ported over from 2.7 as of yet, correct? I
did run across an entry in the change details for Squid 3 Head dealing
with http1.1,
http://www.squid-cache.org/Versions/v3/HEAD/changesets/b9622.patch. Will
this patch allow Live Updates to work?

cache.log:

2009/04/12 07:56:11| assertion failed: MemBuf.cc:388: "new_cap >
(size_t) capacity"
2009/04/12 07:56:14| Starting Squid Cache version 3.1.0.6 for
x86_64-unknown-linux-gnu...
2009/04/12 07:56:14| Process ID 16647
2009/04/12 07:56:14| With 1024 file descriptors available
2009/04/12 07:56:14| Initializing IP Cache...
2009/04/12 07:56:14| DNS Socket created at [::], FD 7
2009/04/12 07:56:14| Adding domain lhtot.com from /etc/resolv.conf
2009/04/12 07:56:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
2009/04/12 07:56:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
2009/04/12 07:56:14| Unlinkd pipe opened on FD 12
2009/04/12 07:56:14| Store logging disabled
2009/04/12 07:56:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
2009/04/12 07:56:14| Target number of buckets: 4397528
2009/04/12 07:56:14| Using 8388608 Store buckets
2009/04/12 07:56:14| Max Mem size: 4194304 KB
2009/04/12 07:56:14| Max Swap size: 1143357440 KB
2009/04/12 07:56:14| Version 1 of swap file without LFS support detected...
2009/04/12 07:56:14| Rebuilding storage in /cache (DIRTY)
2009/04/12 07:56:14| Using Least Load store dir selection
2009/04/12 07:56:14| Set Current Directory to /cache
2009/04/12 07:56:14| Loaded Icons.
2009/04/12 07:56:14| Accepting spoofing HTTP connections at
0.0.0.0:3129, FD 15.
2009/04/12 07:56:14| HTCP Disabled.
2009/04/12 07:56:14| Squid modules loaded: 0
2009/04/12 07:56:14| Ready to serve requests.
2009/04/12 07:56:14| Store rebuilding is 0.67% complete
2009/04/12 07:56:16| Done reading /cache swaplog (610295 entries)
2009/04/12 07:56:16| Finished rebuilding storage from disk.
2009/04/12 07:56:16| 604141 Entries scanned
2009/04/12 07:56:16| 0 Invalid entries.
2009/04/12 07:56:16| 0 With invalid flags.
2009/04/12 07:56:16| 598162 Objects loaded.
2009/04/12 07:56:16| 0 Objects expired.
2009/04/12 07:56:16| 5979 Objects cancelled.
2009/04/12 07:56:16| 0 Duplicate URLs purged.
2009/04/12 07:56:16| 0 Swapfile clashes avoided.
2009/04/12 07:56:16| Took 2.34 seconds (255507.19 objects/sec).
2009/04/12 07:56:16| Beginning Validation Procedure
2009/04/12 07:56:17| 262144 Entries Validated so far.
2009/04/12 07:56:17| 524288 Entries Validated so far.
2009/04/12 07:56:17| 786432 Entries Validated so far.
2009/04/12 07:56:17| 1048576 Entries Validated so far.
2009/04/12 07:56:17| Completed Validation Procedure
2009/04/12 07:56:17| Validated 1196349 Entries
2009/04/12 07:56:17| store_swap_size = 9346436
2009/04/12 07:56:17| storeLateRelease: released 0 objects
2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to
64.201.93.245: (22) Invalid argument
2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed
to bind: (22) Invalid argument
2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to
64.201.93.245: (22) Invalid argument
2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed
to bind: (22) Invalid argument
2009/04/12 07:59:11| assertion failed: MemBuf.cc:388: "new_cap >
(size_t) capacity"
2009/04/12 07:59:14| Starting Squid Cache version 3.1.0.6 for
x86_64-unknown-linux-gnu...
2009/04/12 07:59:14| Process ID 16655
2009/04/12 07:59:14| With 1024 file descriptors available
2009/04/12 07:59:14| Initializing IP Cache...
2009/04/12 07:59:14| DNS Socket created at [::], FD 7
2009/04/12 07:59:14| Adding domain lhtot.com from /etc/resolv.conf
2009/04/12 07:59:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
2009/04/12 07:59:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
2009/04/12 07:59:14| Unlinkd pipe opened on FD 12
2009/04/12 07:59:14| Store logging disabled
2009/04/12 07:59:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
2009/04/12 07:59:14| Target number of buckets: 4397528
2009/04/12 07:59:14| Using 8388608 Store buckets
2009/04/12 07:59:14| Max Mem size: 4194304 KB
2009/04/12 07:59:14| Max Swap size: 1143357440 KB
2009/04/12 07:59:14| Version 1 of swap file without LFS support detected...
2009/04/12 07:59:14| Rebuilding storage in /cache (DIRTY)
2009/04/12 07:59:14| Using Least Load store dir selection
2009/04/12 07:59:14| Set Current Directory to /cache
2009/04/12 07:59:14| Loaded Icons.
2009/04/12 07:59:14| Accepting spoofing HTTP connections at
0.0.0.0:3129, FD 15.
2009/04/12 07:59:14| HTCP Disabled.
2009/04/12 07:59:14| Squid modules loaded: 0
2009/04/12 07:59:14| Ready to serve requests.
2009/04/12 07:59:14| Store rebuilding is 0.67% complete
2009/04/12 07:59:17| Done reading /cache swaplog (610453 entries)
2009/04/12 07:59:17| Finished rebuilding storage from disk.
2009/04/12 07:59:17| 604425 Entries scanned
2009/04/12 07:59:17| 0 Invalid entries.
2009/04/12 07:59:17| 0 With invalid flags.
2009/04/12 07:59:17| 598410 Objects loaded.
2009/04/12 07:59:17| 0 Objects expired.
2009/04/12 07:59:17| 6015 Objects cancelled.
2009/04/12 07:59:17| 0 Duplicate URLs purged.
2009/04/12 07:59:17| 0 Swapfile clashes avoided.
2009/04/12 07:59:17| Took 2.31 seconds (259052.62 objects/sec).
2009/04/12 07:59:17| Beginning Validation Procedure
2009/04/12 07:59:17| 262144 Entries Validated so far.
2009/04/12 07:59:17| 524288 Entries Validated so far.
2009/04/12 07:59:17| 786432 Entries Validated so far.
2009/04/12 07:59:17| 1048576 Entries Validated so far.
2009/04/12 07:59:17| Completed Validation Procedure
2009/04/12 07:59:17| Validated 1196845 Entries
2009/04/12 07:59:17| store_swap_size = 9351900
2009/04/12 07:59:17| storeLateRelease: released 0 objects
2009/04/12 07:59:43| assertion failed: MemBuf.cc:388: "new_cap >
(size_t) capacity"
2009/04/12 07:59:46| Starting Squid Cache version 3.1.0.6 for
x86_64-unknown-linux-gnu...

Thanks,

Tom
Received on Wed Apr 15 2009 - 08:55:25 MDT

This archive was generated by hypermail 2.2.0 : Wed Apr 15 2009 - 12:00:02 MDT