Another interesting compression project is "Zstandard"<p>Open source, high performance, decent compression and a "dictionary mode" that's especially fun when it comes to compressing a lot of small data.<p><a href="http://www.zstd.net" rel="nofollow">http://www.zstd.net</a><p>Previous discussion over at <a href="https://news.ycombinator.com/item?id=8941955" rel="nofollow">https://news.ycombinator.com/item?id=8941955</a>
I guess it's yet another optimised LZ variant, and it's no surprise that LZ-based/inspired algorithms are fast, because their main loop is very simple and does not involve the intense bit manipulation of Huffman/Arithmetic algorithms. That's how very carefully optimised LZ can end up being <i>faster than memcpy()</i> in some cases:<p><a href="http://www.oldskool.org/pc/lz4_8088" rel="nofollow">http://www.oldskool.org/pc/lz4_8088</a>
Few benchmarks from @rygorous:<p><a href="https://gist.github.com/rygorous/67c78fde615e078117ea187047291913" rel="nofollow">https://gist.github.com/rygorous/67c78fde615e078117ea1870472...</a> (on PC)<p><a href="https://gist.github.com/rygorous/9563760e24463a37984c117b5728638d" rel="nofollow">https://gist.github.com/rygorous/9563760e24463a37984c117b572...</a> (on PS4)
How is it compared to Zstandard <a href="https://github.com/Cyan4973/zstd" rel="nofollow">https://github.com/Cyan4973/zstd</a> ?
Is this 3x faster than zlib at decompressing on zlib-compressed data, or 3x faster on samples compressed with its own format versus the same samples compressed with zlib?
Does anyone know how Apple's lzfse [0] compares to some of these other compression algos?<p>>Beginning with iOS 9 and OSX 10.11 El Capitan, we provide Apple’s proprietary compression algorithm, LZFSE. LZFSE is a new algorithm, matching the compression ratio of ZLIB level 5, but with much higher energy efficiency and speed (between 2x and 3x) for both encode and decode operations.<p>I'm interested because of the low energy characteristics...<p>[0] : <a href="https://developer.apple.com/library/tvos/documentation/Performance/Reference/Compression/" rel="nofollow">https://developer.apple.com/library/tvos/documentation/Perfo...</a>
It is no secret that vanilla zlib is slow. Would have been interesting if they compared with <a href="https://github.com/Dead2/zlib-ng" rel="nofollow">https://github.com/Dead2/zlib-ng</a>