Question

When I have downloaded any file directly from twiki.org the .zip file is corrupt and can't be opened. Tried several different computers and different ISPs. Downloads from other sites work fine. The download from twiki.org appears fine but then when I open the computer says it is corrupt. File size is a little smaller than reported on website. This has occured for a week now. Ideas? Help? Someone to download and email me "SpreadSheetPlugin", "TWikiDrawPlugin", "ApplicationAuthenticationAddOn", "SessionPlugin" to bmehl@thebrainmillPLEASENOSPAM.com Thanks, Brian

Environment

-- TWikiGuest - 06 Aug 2005

Answer

If you answer a question - or someone answered one of your questions - please remember to edit the page and set the status to answered. The status selector is below the edit box.

Since recently I experience exactly the same on my Win2k notebook using both WinZIP and ZipGenius, with virus scanner enabled or disabled.

It's not the ISP side, since my Desktop can open the files correctly. (Or could in fact because it died on me yesterday)

Also I experience though that all other zip files downloaded open just fine. This leads me to think that the problem is at least partly caused by TWiki.org... How are the zip files generated?

-- JosMaccabiani - 06 Aug 2005

I just tested the download of the SpreadSheetPlugin and TopicClassificationAddOn on Win XP. I can unpack it with WinZIP, and the size of the downloaded files matches the ones on TWiki.org (47,780 bytes and 7,900 bytes, respectively).

I also checked the mime type setting of TWiki.org's Apache server:

application/zip                 zip

-- PeterThoeny - 07 Aug 2005

The zips are not (yet) dynamically generated. I had one user contact me about this problem with BatchUploadPlugin.

It could possibly be due to the MIME demarcation string appearing naturally in the download. I last looked at the code some 5 years ago when I noticed that TWiki always uses the same string. IIRC the spec says that it should change.

Just a thought.

-- MartinCleaver - 08 Aug 2005

Peter just sent me the zip for TopicClassificationAddOn by e-mail, which opens OK. Meanwhile, from my work desk (different ISP, WinXP, Winzip) downloading directly from the topic leaves me with a corrupt zip. Interestingly:

• "Peter"'s ZIP was 7.900 bytes
• "Downloaded" ZIP was 7.203 bytes

So who of you guys is stealing my 697 bytes???

-- JosMaccabiani - 08 Aug 2005

I downloaded directly TopicClassificationAddOn and got the same results as JosMaccabiani. 7.203 bytes. Brian

-- TWikiGuest - 08 Aug 2005

When you download the ZIP, it gets delivered via static link, not even via TWiki's viewfile scripts. Apache's mime type settings are OK. I am puzzled why some people can download the ZIP just fine, and others get a different file size??? Any advise from a web server guru?

-- PeterThoeny - 08 Aug 2005

> it gets delivered via static link

Good point. In that case I have no idea why its happening.

We could deliver via viewfile instead and see whether it goes away. At least that way we'd also know which plugins are the most popular downloads.

-- MartinCleaver - 08 Aug 2005

On the Bugs web we have been seeing an intermittent problem where the HTTP connection is apparently dropped by the server before transmission is complete, resulting in almost - but - not - quite complete pages being sent to the client. I only mention this because it sounds like a similar problem (though of course it is on a different server).

-- CrawfordCurrie - 18 Aug 2005

I have now tried downloading via earthlink, SBC in St. Louis MO and Chicago IL and all ISPs give me a incomplete (corrupted) download.

-- TWikiGuest - 20 Aug 2005

DanielKabs reported in CoffeeBreak that he had to unzip a downloaded file twice:

gunzip -c TWiki20040902.tar.gz | gunzip -c | tar -tvf -

I haven't tried this yet, maybe this will solve the problem? (I've got no idea how to do this on Windows, by the way)

• Comment: On windows you can try to rename the file to TWiki20040902.tar.gz.gz -- DanielKabs - 23 Aug 2005
• Update: You never know what Windows programs do This is how you help them to extract doubly zipped tar files:
  • download http://twiki.org/swd/TWiki20040902.tar.gz and save it as TWiki20040902.gz (size is 1,827,728 bytes).
  • Double clicking on it shows a file TWiki20040902 with 1,883,008 bytes. Extract it to folder test1.
  • Open folder test1 and rename TWiki20040902 to TWiki20040902.gz.
  • Double clicking on it shows a file TWiki20040902 with 8,181,760 bytes. Extract it to folder test2.
  • Open folder test2 and rename TWiki20040902 to TWiki20040902.tar.
  • Double clicking on it shows the tar file's contents.
  • You have reached the TWiki source code -- DanielKabs - 01 Sep 2005

-- JosMaccabiani - 20 Aug 2005

I have the same set of problemes with downloading - I tried to download ActionTrackerPlugin.zip. I have tried the above suggestion, I have tried WinZip, I have tried unzip on Solaris - however none of it worked for me.

-- JacobBaekke - 23 Aug 2005

I've had some occasional problems downloading .zip files from here as well. same sypmtoms. I changed to right-clicking on the link, and selecting 'save-as'. This seemed to behave correctly every time. Not sure how scientific the test was, as things may just have decided to work on their own...

-- AllanNienhuis - 31 Aug 2005

The suggestion by AllanNienhuis doesn't work for me...

-- JosMaccabiani - 31 Aug 2005

Wonder if trying to use a client side download manager would be helpful?

-- AllanNienhuis - 31 Aug 2005

May be this can help to debug the issue. http://www.rexswain.com/httpview.html lets you examine the HTTP headers. When I download SpreadSheetPlugin.zip at http://twiki.org/p/pub/Plugins/SpreadSheetPlugin/SpreadSheetPlugin.zip I get this:

Parameters:
URL = http://twiki.org/p/pub/Plugins/SpreadSheetPlugin/SpreadSheetPlugin.zip
UAG = Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20041107 Firefox/1.0
AEN =
REQ = GET ; VER = 1.1 ; FMT = AUTO
Sending request:

GET /p/pub/Plugins/SpreadSheetPlugin/SpreadSheetPlugin.zip HTTP/1.1
Host: twiki.org
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20041107 Firefox/1.0
Connection: close

? Finding host IP address...
Host IP address = 204.153.195.50
? Finding TCP protocol...
? Binding to local socket...
? Connecting to host...
? Sending request...
? Receiving response...
Total bytes received = 48065
Elapsed time so far: 1 seconds
Header (Length = 285):
HTTP/1.1?200?OK(CR)(LF)
Date:?Sat,?03?Sep?2005?00:51:47?GMT(CR)(LF)
Server:?Apache/2.0.54?(Unix)?DAV/2(CR)(LF)
Last-Modified:?Mon,?27?Jun?2005?04:21:25?GMT(CR)(LF)
ETag:?"417bf-baa4-7c197b40"(CR)(LF)
Accept-Ranges:?bytes(CR)(LF)
Content-Length:?47780(CR)(LF)
Vary:?Accept-Encoding(CR)(LF)
Connection:?close(CR)(LF)
Content-Type:?application/zip(CR)(LF)
(CR)(LF)
Content (Length = 47780):

       0: 504B030414000000 080033A7DA3206EC PK?????? ??3??2??
      10: 1B712E0400002D09 0000260015006C69 ?q.???-? ??&???li
      20: 622F5457696B692F 506C7567696E732F b/TWiki/ Plugins/
...snip...
    BA70: 5368656574506C75 67696E2E7478742C SheetPlu gin.txt,
    BA80: 765554050003A878 BF4255780000504B vUT????x ?BUx??PK
    BA90: 0506000000000400 04007F0100000FB9 ???????? ????????
    BAA0: 00000000                          ????             

Could someone who experiences the issue test this and post the result?

-- PeterThoeny - 02 Sep 2005

I tried. Apart from the User Agent:

UAG = Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)

Everything is exactly the same, including total bytes, header length, etc.

-- JosMaccabiani - 03 Sep 2005

Interestingly, when I paste the link http://twiki.org/p/pub/Plugins/SpreadSheetPlugin/SpreadSheetPlugin.zip directly in my IE6 address bar, I get the following error:

Then, I downloaded Firefox 1.06, pasted the link in Firefox's address bar and voila! Everything works OK. Does this help?

-- JosMaccabiani - 03 Sep 2005

I tried this too with the zip @ TreeBrowserPlugin.

• IE could download, but the download was corrupt.
• Firefox had no trouble with the file.

-- JosMaccabiani - 04 Sep 2005

ok, problem "solved". sven turned off SetOutputFilter DEFLATE setting in apache. we would prefer to compress everything except already-compressed files. does anyone know how to do that?

-- WillNorris - 05 Sep 2005

Confirmed. Thanks guys!

-- JosMaccabiani - 05 Sep 2005

Good thing that tweaking SetOutputFilter DEFLATE solveD the issue

-- PeterThoeny - 05 Sep 2005

I am getting this problem on my PC again. The zip download won't open and says it is corrupted. However, my Mac downloads it just fine and uncompresses it. Did the SetOutputFilter get untweaked?

-- CharlesSykora - 27 Aug 2006

I am also trying to download skins, but they are downloaded only partially (no matter if the files are .tar.gz or .zip). I am using a screen reader, and IE is the only accessible browser (unfortunately). Thanks.

-- IonPop - 28 Sep 2006

I am sorry to say im have been trying download it for weeks, but all i have got so far are corrupted zip files. Regards

-- DanielKamers - 07 Mar 2007

We had some problem on twiki.org where zip files have been delivered as double-archived. Please try again and report here if it works now.

-- PeterThoeny - 08 Mar 2007