TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Rapidgzip – Parallel Decompression and Seeking in Gzip (Knespel, Brunst – 2023) [pdf]

4 pointsby klauspostover 1 year ago

1 comment

klauspostover 1 year ago
Repo: <a href="https:&#x2F;&#x2F;github.com&#x2F;mxmlnkn&#x2F;rapidgzip">https:&#x2F;&#x2F;github.com&#x2F;mxmlnkn&#x2F;rapidgzip</a><p>As someone who has dabbled quite a lot with deflate this was a very interesting find. It seems like the format that never wants to die.<p>First of all I am surprised this is even possible. Given the extremely minimal and non-aligned nature of the deflate headers, I actually discarded this as being feasible, with the false positive rate likely being too high.<p>The paper and implementation is an amazing piece of engineering. Hats off to the author. With an index, you are in &quot;easy&quot; mode, so I consider the unindexed &quot;hard mode&quot; the big accomplishment.<p>I am still digesting it. So if I read the paper correctly the false positive rate is approximately 1 for every 5GB. Very reasonable.
评论 #37212923 未加载