Pilosa: open source, distributed bitmap index in Go

Hint to the uninformed: don't look up "bitmap" and wonder why anyone would index them. Look up "bitmap index" instead. This will save you many clicks in the github project as well as in your favorite search engine. It's about databases, not pixels.

This is exactly something I&#x27;ve been looking for to experiment with user segmentation, but crucially for fast, ad-hoc segmentation. Seems to bear some similarity to what Facebook [1] does for its audience insights.<p>[1] <a href="https:&#x2F;&#x2F;code.facebook.com&#x2F;posts&#x2F;382299771946304&#x2F;audience-insights-query-engine-in-memory-integer-store-for-social-analytics-&#x2F;" rel="nofollow">https:&#x2F;&#x2F;code.facebook.com&#x2F;posts&#x2F;382299771946304&#x2F;audience-ins...</a>

How does this compare to <a href="https:&#x2F;&#x2F;github.com&#x2F;RoaringBitmap&#x2F;CRoaring" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;RoaringBitmap&#x2F;CRoaring</a>?<p>Is the difference that this one is distributed?

Based on what I can gather from the data model, this would be great for categorical type data where there are a limited amount of categories for each event? Would this be fast for querying quantitative data where values might be unique?

I appreciate how they developed a query language that is more code-like than SQL but still basically declarative and parsimonious.

As I understand, this sort of index is roughly how Elasticsearch is able to do filters quite quickly after warmup. They store bitwise mappings of filter results on a document by document basis.<p>(That said, this is one ES thing that&#x27;s impossible to find documentation for).

Great way to encode discrete answers for qualitative survey data. Reads are smoking fast.

I love the website[0] for the product; very pleasing.<p>[0]: <a href="https:&#x2F;&#x2F;www.pilosa.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.pilosa.com&#x2F;</a>

Very similar to S1Search:<p><a href="https:&#x2F;&#x2F;blog.slicingdice.com&#x2F;slicingdice-uncovered-part-2-s1search-33d2240a96c1" rel="nofollow">https:&#x2F;&#x2F;blog.slicingdice.com&#x2F;slicingdice-uncovered-part-2-s1...</a><p><a href="https:&#x2F;&#x2F;blog.slicingdice.com&#x2F;slicingdice-uncovered-part-3-s1search-in-depth-bb72f3955c27" rel="nofollow">https:&#x2F;&#x2F;blog.slicingdice.com&#x2F;slicingdice-uncovered-part-3-s1...</a>