HyperLogLog
Languages and libraries
probabilistic data structure library
SHOW HN2017
How HN took it
2 positive, 15 neutral or asking, 0 mixed, 3 critical, out of 20 comments about the project. Thread score +0.06.
Execution: 0 for, 2 againstIdea: 1 for, 0 againstDocs: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Smaller space usage with good accuracy
From 1 comment
This is absolutely amazing. Seems like a great tradeoff of having smaller space usage and better accurancy on average at the same time. It is also worth to read the related white…
StreamBright on HN
Useful for monitoring systems that use HyperLogLogs
From 1 comment
This is awesome! We make heavy use of HyperLogLogs in our monitoring systems[0], which are also written in Go and currently use Clark Duvall's library, which this library is…
chimeracoder on HN
Objections
TailCut can make results order-dependent when values repeat
From 1 comment
The tailcut approach breaks one important property of cardinality estimation algorithms: Adding the same value multiple times should change the state of the sketch only once when…
oertl on HN
Space claims lack a clear comparison table
From 2 comments
I don't understand what the result table measures. What are the numbers and what is the "Exact" column?
lorenzhs on HNThat doesn't match up with the tagline "An improved version of HyperLogLog for the count-distinct problem, approximating the number of distinct elements in a multiset using…
lorenzhs on HN
Requests
Implementations in Python or Java
From 1 comment
I'm looking for implementations of this in other languages. Specifically in Python or Java. Please hook me up if you know of any such implementation.
JensRantil on HN
Intersection support for two HLL instances
From 1 comment
Do you guys know any way to calculate the intersection of two HLL instances? The algorithm allows merging two sets but it's not that easy to take the intersection of them. A + B…
buremba on HN
Comprehensive benchmark across Go implementations
From 1 comment
There really are a lot of hyperloglog implementations in go. I'd be interested in seeing a comprehensive comparison between implementations for speed, accuracy and space…
helper on HN
Questions
How does TailCut compare with Ertl's estimator
From 1 comment
How does the Xiao et al. paper (which introduces TailCut, "Better with Fewer Bits: Improving the Performance of Cardinality Estimation of Large Data Streams",…
jbapple on HN
Why MetroHash rather than xxHash
From 1 comment
why use metro hash instead of xxhash ?
tmaly on HN
Alternatives named
Redis HyperLogLog
From 1 comment
Somewhat similar to Redis implementation in many ways: Redis also uses loglog-beta, sparse representations, and dense representations in packed format without wasting 1 byte.…
antirez on HN
Clark Duvall's Go HyperLogLog library
From 1 comment
This is awesome! We make heavy use of HyperLogLogs in our monitoring systems[0], which are also written in Go and currently use Clark Duvall's library, which this library is…
chimeracoder on HN
Cuckoo filter
From 1 comment
https://github.com/seiflotfy/cuckoofilter but this will require you to know how many max unique values per status your will have.
seiflotfy on HN