TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN:Fastest Range Coder for byte, integer, floating point data and BWT

2 pointsby powturboover 3 years ago

1 comment

powturboover 3 years ago
100% C (C++ headers).<p>OS&#x2F;Arch: Linux amd&#x2F;intel, arm, PowerPC, s390x, MacOs+Apple M1. Windows: Mingw, visual c++<p>No other Range Coder &#x2F; Arithmetic Coder encode or decode faster with better compression<p>Up to 3 times faster than the next fastest range coder with similar compression ratio<p>Can work as bitwise or&#x2F;and as multisymbol range coder 32 or 64 bits range coder. Big + Little endian Renormalization output 8,16 or 32 bits<p>Easy connection to bit, nibble or byte predictors.<p>Several built-in predictors: simple, dual speed, newfsm Built-in order0, order1, order2, Sliding Context, newContext mixing,<p>- Run Length Encoding, Gamma Coding, newRice Coding, - newBit entropy coding,<p>- newTurbo VLC: novel Variable Length Coding for large integers,<p>- MTF (Move-To-Front) &#x2F; QLFC (Quantized Local Frequency Coding)<p>Fast full 8&#x2F;16 bits BWT: Burrows-Wheeler compression&#x2F;decompression w&#x2F; preprocessing : lzp and newutf-8<p>postprocessing: QLFC (Quantized Local Frequency Coding), newRLE and newBit entropy coder<p>BWT newlibsais + optimized libdivsufsort + newoptimized inverse bwt included<p>static + adaptive cdf - cumulative distribution functions stdin&#x2F;stdout file compressor included<p>TurboRC App for benchmarking all the functions and test allmost all byte, integer, floating point, date and timestamp file types.<p>newread and convert text, csv or binary files to 8&#x2F;16&#x2F;32 bits before processing newset predictor and parameters at the command line