Tempest
Infrastructure
search cluster balancing
SHOW HN2015
23points
9comments
#1,115of 2,565 in 2015
Top 44%of 2015 by points
How HN took it
CuriousMostly questions and neutral comments
3 positive, 3 neutral or asking, 0 mixed, 0 critical, out of 6 comments about the project. Thread score +0.29.
Idea: 3 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Unique use case explained well
From 1 comment
Thank you for the detailed explanation. It seems like a unique use case. I've yet much to learn about ES :). Glad you are releasing this as a plugin!
gt565k on HN
Interesting alternative approach via OptaPlanner
From 2 comments
This seems quite cool. For very large clusters, I'd also consider looking into Optaplanner, which exposes a variety of probabilistic metaheuristics for balancing. There's a…
divideby0 on HNOh nice! That looks close to what we were trying to do with this plugin. I'm not sure it would've worked within the constraints of the Elasticsearch environment, but the…
adenverd on HN
Objections
Uneven shards may signal a poor data model or architecture
From 1 comment
You mention "... however, that none of these balancing options are resource-aware: there is no “balance shards across nodes by the size of the shards” flag to set or knob to…
gt565k on HN
Balancing by shard size is not resource-aware in default ES
From 1 comment
You mention "... however, that none of these balancing options are resource-aware: there is no “balance shards across nodes by the size of the shards” flag to set or knob to…
gt565k on HN
Requests
Data on time to bring nodes online or offline
From 1 comment
Do you have any data on bringing new nodes online / offline? Obviously, rebalancing in general is going to be I/O-intensive if you have a ton of data, but has Tempest shown any…
tobz on HN
Questions
Does it speed up or slow down adding a new node?
From 1 comment
Do you have any data on bringing new nodes online / offline? Obviously, rebalancing in general is going to be I/O-intensive if you have a ton of data, but has Tempest shown any…
tobz on HN
Alternatives named
OptaPlanner cloud balancing
From 1 comment
This seems quite cool. For very large clusters, I'd also consider looking into Optaplanner, which exposes a variety of probabilistic metaheuristics for balancing. There's a…
divideby0 on HN