Rapid lossless data compression of numerical or string variables

Rapidly compresses (or decompresses) Matlab variables in memory

Description

Using the public domain ZLIB Deflator algorithm, these two functions (DZIP and DUNZIP) losslessly compress or decompress MATLAB variables of most data types so that they occupy less space. Class type and variable size and shape are stored within the compressed data.

NOTES:
(1) The input variable can be a scalar, vector, matrix, or n-dimensional matrix
(2) The input variable must be a non-complex and full (meaning matrices declared as type "sparse" are not allowed)
(4) In testing, DZIP compresses several megabytes of data per second.
(5) In testing, sparsely populated matrices or matrices with regular structure can compress to less than 10% of their original size. The realized compression ratio is heavily dependent on the data. (For example, a large stream of truly random data is theoretically impossible to compress.)
(6) Variables originally occupying very little memory (less than about half of one kilobyte) are handled correctly, but the compression requires some overhead and may actually increase the storage size of such small data sets. One exception to this rule is noted next.
(7) LOGICAL variables are compressed to a small fraction of their original sizes.
(8) The DUNZIP function decompresses the output of this function and restores the original data, including size and class type.
(9) This function uses the public domain ZLIB Deflater algorithm.
(10) Carefully tested, but no warranty; use at your own risk.
(11) Michael Kleder, Nov 2005

• Acknowledgements: This submission has inspired the following:; Compression Routines
• MATLAB release: MATLAB 7.0.4 (R14SP2)
• Other requirements: Java is called by these functions.
• Other Files: dunzip.m, ; dzip.m

[Matlab User]

Very clever, very simple
Thanks a lot!

[Pranas Baliuka]

Thanks! KISS. Excellent. I wonder why Mathworks did not create as standart e.g. in communication toolbox or even in core ...

[Matlab User]

A simple, easy to use file that made my application not eat up 1.5 gigs+ of memory. Thumbs up.

[Zack Voulgaris]

An exceptional piece of code. Short, fast and effective.

[rajchandar k]

hello every one.. how to use this files with Rapid AES algorithm explain with procedure...

thank U......

[Jesse Hopkins]

Using R2008b an exception occurs at line 24 of dunzip:
??? Java exception occurred:
java.util.zip.ZipException: unknown compression method

at java.util.zip.InflaterInputStream.read(Unknown Source)

at java.io.FilterInputStream.read(Unknown Source)

at com.mathworks.mlwidgets.io.InterruptibleStreamCopier.copyStream(InterruptibleStreamCopier.java:97)

at com.mathworks.mlwidgets.io.InterruptibleStreamCopier.copyStream(InterruptibleStreamCopier.java:76)

Any thoughts on what needs to be changed?

[Jesse Hopkins]

Needed to make the following changes to eliminate above java exceptions (in R2008b)

dzip.m line 48: change "DeflaterOutputStream" to "GZIPOutputStream"

dunzip.m line 21: change "InflaterInputStream" to "GZIPInputStream"