DeflOpt thread

[Zardalu]

Thanks, Ken, for clarifying what I meant. Yes, I should have stated that more clearly. A long time ago, I wrote a utility to "fix" MP3s. I found that the last frame (if indeed it WAS the last to start with) often had a few bytes missing. Most players didn't care and played the files correctly. Correctly in the sense that the person listening to them wouldn't be able to tell. But I, being as anal as I am, wanted my MP3s to not be corrupt. So I wrote my utility and it told me when an MP3 was corrupt and it fixed it by making the corrupt last frame correct (filling it with "nothing"... after all, you can't hear the corruption 99% of the time it anyway).

What I meant, really, was that the glocal directory of a ZIP file is all the way at the end of that ZIP file. The local entries are not. Now apart from the case of a "streaming ZIP file" (and my ZIP file reading code handles those correctly), where the CRCs are not known until afterwards, the entries in the global directory at the end of a ZIP file should be identical to the local entries earlier on in the ZIP file. So if you get a ZIP file with some bytes at the end missing, then there will be discrepancies between global and local, because global is incomplete. All PKZIPFIX does is that it reads the local entries and constructs a new global directory from those.

In pretty much all my programming, I rather am safe than sorry. So when something is wrong, I don't make assumptions that have the risk of losing things. That's why DeflOpt bitches and quits. I really don't want to make DeflOpt less reliable, so the alternative would be for me to write something similar to my MP3 utility and similar to PKZIPFIX. But I'll have a look first at those files to see exactly what the problem is.

Ben Jos.

[Zardalu]

I was not aware that data in MP3s were also compressed with ZIP.

There is no ZIP in MP3. You read Zardalu's words wrong. He was referring to a bug with file sharing services not always sending the whole file. MP3, being a popular file type, is often where the problem is noticed.

I'm sure that in some cases, it's a bug, but I'm also sure that in other cases, it's a situation of someone uploading a file and being kind enough to wait until it finishes uploading, but then still disconnecting a few seconds early because it seemed to him that the file had finished uploading, but the last few bytes still never arrived. And in the case of file sharing services, a lot of files (including corrupt ones) multiply like rabbits...

Ben Jos.

[Zardalu]

I am going to release version 2.03 immediately after posting this message. 2.03 only fixes 2 problems. No change in speed or optimisation performance.

fred01: Thanks again for the files. I examined them and found that they WERE correct after all. So DeflOpt did it wrong. Fixed in 2.03.

fred01: Sorry, I added some code a while ago to add a logging option, but I have not yet finished it. So logging is not in 2.03.

Andrew: Sorry, but I have not yet made the "silent" switch even more silent.

The way things look now, 2.04 will be released in December and it will include the two things mentioned above that did not make it into 2.03.

Go to http://www.walbeehm.com/download/ to download it and either e-mail me (read DeflOpt.txt) or post something in this thread for comments, problems, and so on. Note that e-mail is faster because I don't check here very often and I have notifications turned off.

Ben Jos.

[fred01]

fred01: Thanks again for the files. I examined them and found that they WERE correct after all. So DeflOpt did it wrong. Fixed in 2.03.

I tried, but now get: "ERROR: Zero length data." with the file. I double checked by redownloading it and comparing with a local copy I forgot to erase :roll: and they are binary identical, so there were no corruption during the transfer.
Could you try to look at it again? (or try with your own file if you have OpenOffice installed. I have this error with all my files).

fred01: Sorry, I added some code a while ago to add a logging option, but I have not yet finished it. So logging is not in 2.03.

Thank you for thinking about it, and take you time with this one, as it is a "convenience option".

[Zardalu]

I tried, but now get: "ERROR: Zero length data." with the file.

There is something strange with the file "current.xml" inside that archive. It is a zero-length file, but its compressed size is given as 2. Normally, DeflOpt does not have a problem with zero-length files, but for some reason, this one causes problems. I'll have a closer look.

Ben Jos.

[Zardalu]

I tried, but now get: "ERROR: Zero length data."

This is fixed in version 2.04. Get it from http://www.walbeehm.com/download/. I have also updated the other tools there since they were affected too.

Ben Jos.

[fred01]

This is fixed in version 2.04. Get it from http://www.walbeehm.com/download/. I have also updated the other tools there since they were affected too.

Works fine now, thank you.
(Sorry for the delay, somehow I missed your last reply in the thread.  )

[jojo4u]

Hello Ben Jos,

your download site http://www.walbeehm.com/download is down since some days. And I couldn't find a mirror. Could somebody please point me to a copy?
Version 2.02 apparently creates a BJWxxxx.tmp file in the %TMP% directory when it's not able to compress the file. I once had 19 000 files in my temp directory after some extensive testing ...

[Zardalu]

your download site http://www.walbeehm.com/download is down since some days.

It's a DNS problem. The IP has changed recently and DNS servers take a while to catch up. I find that I can't access walbeehm.com myself from home, but I can from my job... .

If you can't wait, send me an e-mail to walbeehm.com with the part before the "@" also "walbeehm". And put DeflOpt in the subject.

Ben Jos.

[Zardalu]

Alternatively, in the mean time, http://web12.topchoice.com/~walbeehm/download should still work.

Ben Jos.

[jojo4u]

Thanks, both pages are working now.

In 2.04, there is still the problem with the temp file. Thanks to this, I got 65000+ files at one point in my temp dir. This slowed down DeflOpt significantly! Basically, it creates a BJWxxxx.tmp file in the %TMP% directory when it's not able to compress the file further. Command line is: deflopt.exe /k /s file > nul

[Zardalu]

In 2.04, there is still the problem with the temp file. [...] Basically, it creates a BJWxxxx.tmp file in the %TMP% directory

Thanks! Fixed in 2.05. Available now from http://www.walbeehm.com/download.

Ben Jos.

[Zardalu]

OK. I know this is a shameless plug, but it also gives some information on the programs I have made available for download. I have actually made a "real page" out of my download page: http://www.walbeehm.com/download/.

Ben Jos.

[krick]

OK. I know this is a shameless plug, but it also gives some information on the programs I have made available for download. I have actually made a "real page" out of my download page: http://www.walbeehm.com/download/.

Ben Jos.

I'm having trouble downloading files from your page.  It looks like your web server is sending a content type of "html" for "7z" files.  When I click on one of the download links, IE shows me the contents of the file instead of prompting me with the download dialog.  It's possible that there's a problem with IE on my end but I just wanted to check if anyone else is seeing the same thing.

[Sined]

I have the same “problem”, you just need a right click, and “save to”.