TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Pilosa: An open source, distributed index

110 pointsby josephturnipalmost 6 years ago

7 comments

joshuaellingeralmost 6 years ago
Technically, it is very interesting -- it uses Roaring Bitmaps under the hood and builds a query engine on it. So an easy way to think about it is that it maps categorical data into a giant compressible distributed bitmap.<p>I&#x27;ve been planning to see if I can (mis)use it as an OLAP replacement but I haven&#x27;t had time to get to it.
评论 #20060653 未加载
jaffeealmost 6 years ago
Source code:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;pilosa&#x2F;pilosa" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;pilosa&#x2F;pilosa</a>
eismccalmost 6 years ago
&gt;Pilosa is a standalone index for big data. Its goal is to help big data storage solutions support real time, complex queries without resorting to pre-computation or approximation. Pilosa achieves this goal by implementing a distributed bitmap index which provides a compact representation not of the data itself, but of the relationships present in the data.<p><a href="https:&#x2F;&#x2F;www.pilosa.com&#x2F;pdf&#x2F;PILOSA%20-%20Technical%20White%20Paper.pdf" rel="nofollow">https:&#x2F;&#x2F;www.pilosa.com&#x2F;pdf&#x2F;PILOSA%20-%20Technical%20White%20...</a>
sktrdiealmost 6 years ago
Not sure who this document is aimed to. It&#x27;s not technical enough to appeal to programmers that are working closely with Pilosa. And it&#x27;s not written in a way to make it easy to understand for people that don&#x27;t know anything about Pilosa (such as myself). I mean a subtitle called &quot;Time Quantum&quot; is enough to make me confused. Would appreciate a more generic &quot;what is this&quot; intro if possible.
评论 #20059685 未加载
评论 #20059302 未加载
评论 #20060472 未加载
continuationsalmost 6 years ago
How do you handle race conditions? E.g. an app updated the persistent store but crashed before it could update Pilosa?
评论 #20060455 未加载
ahazred8taalmost 6 years ago
&quot;Continuous Analysis on Really Big Data - Pilosa is an open source, distributed bitmap index&quot; <a href="https:&#x2F;&#x2F;www.pilosa.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.pilosa.com&#x2F;</a>
shuzchenalmost 6 years ago
Any chance there&#x27;ll be some built-in support to perform collaborative filtering? Seems like a database of relations like this would be awesome for user-based collaborative filtering.
评论 #20082531 未加载