Re: [squid-users] Squid with Tproxy

trasor wrote:
> Running squid with tproxy I am seeing entries in the cache log of
> 'commBind: cannot bind to socket FD # to x.x.x.ip: (22) Invalid
> argument'. This is followed by a 'Warning: Reset of FD # for x.x.x.ip
> failed to bind: (22) Invalid argument'. From reading, this may be
> related to an end user using ftp and as such should be ok just a
> nuisance in the cache log. However, I am also seeing 'assertion failed:
> MemBuf .cc:388: "new_cap > (size_t) capacity"' whereby squid immediately
> restarts initialization and once initialized I start seeing the same
> 'commBind' entries. I understand these 'commBind' entries are occurring
> because squid has reinitialized and are no longer bond to the associated
> connections. My server has 16GB of ram and the swap is not being
> touched so I am not following why the 'new_cap is greater than size_t
> capacity'. There are also occasions where after the assertion failure
> occurs, squid does not restart on its own.

Squid uses dynamic-length buffers which greatly help overruns.
That assertion is showing that a buffer is being _expanded_ to a size
smaller than it started.
We need a stack trace to see where that shrink is occuring, it may be
useful to allow shrinks, but we have yet to find a real case for it.

>
> Another issue is dealing with Norton LiveUpdate and http1.1 Looking
> thru the forums I see the fix is to place http11 after the http_port,
> i.e. 'http_port 3129 tproxy http11'. But according to the change log
> that function has not been ported over from 2.7 as of yet, correct? I
> did run across an entry in the change details for Squid 3 Head dealing
> with http1.1,
> http://www.squid-cache.org/Versions/v3/HEAD/changesets/b9622.patch. Will
> this patch allow Live Updates to work?

There was a broken version of Norton LU that refused to respond to
HTTP/1.0 clients. Last I heard they Norton released an updated version
without that problem.

>
> cache.log:
>
> 2009/04/12 07:56:11| assertion failed: MemBuf.cc:388: "new_cap >
> (size_t) capacity"
> 2009/04/12 07:56:14| Starting Squid Cache version 3.1.0.6 for
> x86_64-unknown-linux-gnu...
> 2009/04/12 07:56:14| Process ID 16647
> 2009/04/12 07:56:14| With 1024 file descriptors available
> 2009/04/12 07:56:14| Initializing IP Cache...
> 2009/04/12 07:56:14| DNS Socket created at [::], FD 7
> 2009/04/12 07:56:14| Adding domain lhtot.com from /etc/resolv.conf
> 2009/04/12 07:56:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
> 2009/04/12 07:56:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
> 2009/04/12 07:56:14| Unlinkd pipe opened on FD 12
> 2009/04/12 07:56:14| Store logging disabled
> 2009/04/12 07:56:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
> 2009/04/12 07:56:14| Target number of buckets: 4397528
> 2009/04/12 07:56:14| Using 8388608 Store buckets
> 2009/04/12 07:56:14| Max Mem size: 4194304 KB
> 2009/04/12 07:56:14| Max Swap size: 1143357440 KB
> 2009/04/12 07:56:14| Version 1 of swap file without LFS support detected...
> 2009/04/12 07:56:14| Rebuilding storage in /cache (DIRTY)
> 2009/04/12 07:56:14| Using Least Load store dir selection
> 2009/04/12 07:56:14| Set Current Directory to /cache
> 2009/04/12 07:56:14| Loaded Icons.
> 2009/04/12 07:56:14| Accepting spoofing HTTP connections at
> 0.0.0.0:3129, FD 15.
> 2009/04/12 07:56:14| HTCP Disabled.
> 2009/04/12 07:56:14| Squid modules loaded: 0
> 2009/04/12 07:56:14| Ready to serve requests.
> 2009/04/12 07:56:14| Store rebuilding is 0.67% complete
> 2009/04/12 07:56:16| Done reading /cache swaplog (610295 entries)
> 2009/04/12 07:56:16| Finished rebuilding storage from disk.
> 2009/04/12 07:56:16| 604141 Entries scanned
> 2009/04/12 07:56:16| 0 Invalid entries.
> 2009/04/12 07:56:16| 0 With invalid flags.
> 2009/04/12 07:56:16| 598162 Objects loaded.
> 2009/04/12 07:56:16| 0 Objects expired.
> 2009/04/12 07:56:16| 5979 Objects cancelled.
> 2009/04/12 07:56:16| 0 Duplicate URLs purged.
> 2009/04/12 07:56:16| 0 Swapfile clashes avoided.
> 2009/04/12 07:56:16| Took 2.34 seconds (255507.19 objects/sec).
> 2009/04/12 07:56:16| Beginning Validation Procedure
> 2009/04/12 07:56:17| 262144 Entries Validated so far.
> 2009/04/12 07:56:17| 524288 Entries Validated so far.
> 2009/04/12 07:56:17| 786432 Entries Validated so far.
> 2009/04/12 07:56:17| 1048576 Entries Validated so far.
> 2009/04/12 07:56:17| Completed Validation Procedure
> 2009/04/12 07:56:17| Validated 1196349 Entries
> 2009/04/12 07:56:17| store_swap_size = 9346436
> 2009/04/12 07:56:17| storeLateRelease: released 0 objects
> 2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to
> 64.201.93.245: (22) Invalid argument
> 2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed
> to bind: (22) Invalid argument
> 2009/04/12 07:58:14| commBind: Cannot bind socket FD 147 to
> 64.201.93.245: (22) Invalid argument
> 2009/04/12 07:58:14| WARNING: Reset of FD 147 for 64.201.93.245 failed
> to bind: (22) Invalid argument
> 2009/04/12 07:59:11| assertion failed: MemBuf.cc:388: "new_cap >
> (size_t) capacity"
> 2009/04/12 07:59:14| Starting Squid Cache version 3.1.0.6 for
> x86_64-unknown-linux-gnu...
> 2009/04/12 07:59:14| Process ID 16655
> 2009/04/12 07:59:14| With 1024 file descriptors available
> 2009/04/12 07:59:14| Initializing IP Cache...
> 2009/04/12 07:59:14| DNS Socket created at [::], FD 7
> 2009/04/12 07:59:14| Adding domain lhtot.com from /etc/resolv.conf
> 2009/04/12 07:59:14| Adding nameserver 12.199.163.4 from /etc/resolv.conf
> 2009/04/12 07:59:14| Adding nameserver 74.51.162.4 from /etc/resolv.conf
> 2009/04/12 07:59:14| Unlinkd pipe opened on FD 12
> 2009/04/12 07:59:14| Store logging disabled
> 2009/04/12 07:59:14| Swap maxSize 1143357440 KB, estimated 87950572 objects
> 2009/04/12 07:59:14| Target number of buckets: 4397528
> 2009/04/12 07:59:14| Using 8388608 Store buckets
> 2009/04/12 07:59:14| Max Mem size: 4194304 KB
> 2009/04/12 07:59:14| Max Swap size: 1143357440 KB
> 2009/04/12 07:59:14| Version 1 of swap file without LFS support detected...
> 2009/04/12 07:59:14| Rebuilding storage in /cache (DIRTY)
> 2009/04/12 07:59:14| Using Least Load store dir selection
> 2009/04/12 07:59:14| Set Current Directory to /cache
> 2009/04/12 07:59:14| Loaded Icons.
> 2009/04/12 07:59:14| Accepting spoofing HTTP connections at
> 0.0.0.0:3129, FD 15.
> 2009/04/12 07:59:14| HTCP Disabled.
> 2009/04/12 07:59:14| Squid modules loaded: 0
> 2009/04/12 07:59:14| Ready to serve requests.
> 2009/04/12 07:59:14| Store rebuilding is 0.67% complete
> 2009/04/12 07:59:17| Done reading /cache swaplog (610453 entries)
> 2009/04/12 07:59:17| Finished rebuilding storage from disk.
> 2009/04/12 07:59:17| 604425 Entries scanned
> 2009/04/12 07:59:17| 0 Invalid entries.
> 2009/04/12 07:59:17| 0 With invalid flags.
> 2009/04/12 07:59:17| 598410 Objects loaded.
> 2009/04/12 07:59:17| 0 Objects expired.
> 2009/04/12 07:59:17| 6015 Objects cancelled.
> 2009/04/12 07:59:17| 0 Duplicate URLs purged.
> 2009/04/12 07:59:17| 0 Swapfile clashes avoided.
> 2009/04/12 07:59:17| Took 2.31 seconds (259052.62 objects/sec).
> 2009/04/12 07:59:17| Beginning Validation Procedure
> 2009/04/12 07:59:17| 262144 Entries Validated so far.
> 2009/04/12 07:59:17| 524288 Entries Validated so far.
> 2009/04/12 07:59:17| 786432 Entries Validated so far.
> 2009/04/12 07:59:17| 1048576 Entries Validated so far.
> 2009/04/12 07:59:17| Completed Validation Procedure
> 2009/04/12 07:59:17| Validated 1196845 Entries
> 2009/04/12 07:59:17| store_swap_size = 9351900
> 2009/04/12 07:59:17| storeLateRelease: released 0 objects
> 2009/04/12 07:59:43| assertion failed: MemBuf.cc:388: "new_cap >
> (size_t) capacity"
> 2009/04/12 07:59:46| Starting Squid Cache version 3.1.0.6 for
> x86_64-unknown-linux-gnu...
>
> Thanks,
>
> Tom

-- 
Please be using
   Current Stable Squid 2.7.STABLE6 or 3.0.STABLE14
   Current Beta Squid 3.1.0.7