Re: [squid-users] Webpage partially downloaded via squid

Gerard Saunders wrote:
> Hi,
>
> I have a strange issue where one website in particular is typically never being fully downloaded when accessing it via our squid proxy.
>
> It doesn't matter which browser is used, and the behaviour can be simulated using squidclient. If you do a browser reload/refresh, the page is downloaded fine, but subsequent calls to the same website fail.
>
> In addition, if you don't use the proxy at all, the page is downloaded/rendered without any issues at all.
>
> Judging by the output shown below, the website itself seems to be giving a heap of garbage to squid on the initial requests, but I am after reassurance that this is the case.
>
> Anyway, any help would be appreciated.
>
> Here is some info showing this:
>
> Initial request via squid:
>
> 1256518175.833 2 128.184.148.154 TCP_IMS_HIT/304 334 GET http://www.movebank.org/community/info_icon.gif gerards NONE/- image/gif
> 1256518176.074 1046 128.184.148.154 TCP_MISS/200 19179 GET http://www.movebank.org/community gerards DIRECT/128.112.89.94 text/html
> 1256518176.594 519 128.184.148.154 TCP_MISS/404 638 GET http://www.movebank.org/bar_1_10.gif gerards DIRECT/128.112.89.94 text/html
>
> Subsequent refresh of same page:
>
> 1256518384.321 1435 128.184.148.154 TCP_MISS/200 25382 GET http://www.movebank.org/community gerards DIRECT/128.112.89.94 text/html
> 1256518384.367 557 128.184.148.154 TCP_REFRESH_MISS/200 4042 GET http://www.movebank.org/community/IEFixes.css gerards DIRECT/128.112.89.94 text/css
> 1256518384.367 557 128.184.148.154 TCP_REFRESH_MISS/200 1830 GET http://www.movebank.org/community/plone_minwidth.js gerards DIRECT/128.112.89.94 application/x-javascript
> 1256518385.720 1911 128.184.148.154 TCP_REFRESH_MISS/200 67129 GET http://www.movebank.org/community/portal_javascripts/Plone%20Tableless/ploneScripts3251.js gerards DIRECT/128.112.89.94 application/x-javascript
> 1256518386.462 720 128.184.148.154 TCP_REFRESH_MISS/200 681 GET http://www.movebank.org/community/portal_css/Plone%20Tableless/ploneStyles1912.css gerards DIRECT/128.112.89.94 text/css
> 1256518387.491 1752 128.184.148.154 TCP_REFRESH_MISS/200 77641 GET http://www.movebank.org/community/portal_css/Plone%20Tableless/ploneStyles2899.css gerards DIRECT/128.112.89.94 text/css
> 1256518388.042 536 128.184.148.154 TCP_REFRESH_MISS/200 681 GET http://www.movebank.org/community/portal_css/Plone%20Tableless/ploneStyles2817.css gerards DIRECT/128.112.89.94 text/css
> 1256518388.583 538 128.184.148.154 TCP_REFRESH_MISS/200 676 GET http://www.movebank.org/community/portal_css/Plone%20Tableless/ploneStyles4785.css gerards DIRECT/128.112.89.94 text/css
> 1256518389.155 565 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/bar_1_10.gif gerards DIRECT/128.112.89.94 -
> 1256518389.163 575 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/newsitem_icon.gif gerards DIRECT/128.112.89.94 -
> 1256518389.165 577 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/info_icon.gif gerards DIRECT/128.112.89.94 -
> 1256518389.170 580 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/user.gif gerards DIRECT/128.112.89.94 -
> 1256518389.177 589 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/print_icon.gif gerards DIRECT/128.112.89.94 -
> 1256518389.180 585 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/linkTransparent.gif gerards DIRECT/128.112.89.94 -
> 1256518389.684 528 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/bullet.gif gerards DIRECT/128.112.89.94 -
> 1256518389.700 529 128.184.148.154 TCP_REFRESH_HIT/304 405 GET http://www.movebank.org/community/logo.gif gerards DIRECT/128.112.89.94 -
> 1256518389.720 541 128.184.148.154 TCP_REFRESH_HIT/304 336 GET http://www.movebank.org/community/input_background.gif gerards DIRECT/128.112
>
> ##################################################################################################################################
>
> Using squidclient through the proxy:
>
>
> HTTP/1.0 200 OK
> Date: Mon, 26 Oct 2009 23:56:41 GMT
> Server: Apache/2.0.52 (PU_IAS)
> Expires: Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 0
0:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT
> Content-Language: en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en
> Content-Length: 17191
> Content-Type: text/html;charset=utf-8
> Age: 20849
> X-Cache: MISS from titania.its.deakin.edu.au
> X-Cache-Lookup: MISS from titania.its.deakin.edu.au:3128
> Via: 1.0 titania.its.deakin.edu.au:3128 (squid/2.6.STABLE21)
> Proxy-Connection: close
>
> g/community/print_icon.gif"
> alt="Print this page"
> title="Print this page" id="icon-print" />
> </a>
> </li>
>
> As show above the majority of the webpage is missing.. e.g. <html><body> tags
>
>
> Regards,
>
> Gerard.

I can confirm that.

Duplicate Expires and Content-Language headers, the first ones filled
with complete garbage.

I do get the full page content though.

squidclient -h www.movebank.org -p 80 -H 'Host: www.movebank.org\n'
/community

HTTP/1.1 200 OK
Date: Tue, 27 Oct 2009 06:38:19 GMT
Server: Zope/(Zope 2.9.8-final, python 2.4.4, linux2) ZServer/1.1
Plone/2.5.4-2
Expires: Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT,
Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Ja
n 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT
, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01
Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00
GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat,
01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan
2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:0
0 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT,
Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan
2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT,
Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01
Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00
:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00
GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01
  Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00
GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat,
01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 20
00 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00
GMT, Sa
t, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan
2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:0
0:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT,
Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 J
an 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000
00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GMT, Sat, 01 Jan 2000 00:00:00 GM
T
Content-Language: en, en, en, en, en, en, en, en, en, en, en, en, en,
en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, e
n, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en,
en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en, en,
en, en
Content-Length: 24931
Expires: Sat, 01 Jan 2000 00:00:00 GMT
Content-Type: text/html;charset=utf-8
Content-Language: en
Connection: close

Amos

-- 
Please be using
   Current Stable Squid 2.7.STABLE7 or 3.0.STABLE19
   Current Beta Squid 3.1.0.14