TorrentPeek

Data

distributed search engine

SHOW HN2017

184points
33comments
#191of 2,242 in 2017
Top 9%of 2017 by points

How HN took it

DebatedReal support and real criticism

4 positive, 7 neutral or asking, 0 mixed, 4 critical, out of 15 comments about the project. Thread score -0.04.

Performance: 2 for, 2 againstExecution: 0 for, 2 againstIdea: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Clever idea of using SQLite VFS over torrent pieces

    From 2 comments
    • Cool idea! Surprised that SQLite can know exactly which pieces it will need to answer any query!
      halflings on HN
    • Huh. So it's basically just a torrent-VFS, and sqlite already plays nicely? Neat application though! Seems like it works really well :)
      Groxx on HN
  • Good fit for package managers and distributed datasets

    From 2 comments
    • Do you think something like this could be used for some form of a distributed blob store that you can query? Things like package managers could use this effectively.
      gravypod on HN
    • It's a perfect idea for package managers. And they could expand on it, like forcing clients to download a certain number of random pieces depending on the amount of seeds to make…
      zzzcpan on HN

Objections

  • Only works on macOS because binaries are macOS-only

    From 2 comments
    • How does it only work on macOS if it's based on Node? Seems like they could have gotten it to work on Windows and Linux.
      skrowl on HN
    • It needs a few libraries (libtorrent, sqlite) which seem to be packaged as binaries for macOS only - build them anew for your platform and it will probably run.
      misterdata on HN
  • Repository contains clutter and no clear source

    From 2 comments
    • The repository seems to contain a lot of garbage (such as an `a.out` file and a `reddit-browser` folder). This look like a really cool project. Could you please clean up the repo…
      JD557 on HN
    • where is the source code?
      formula_ninguna on HN
  • Latency and download cost of partial index fetches are unclear

    From 1 comment
    • Is 640KiB not the whole index? Because partial download would mean having to request new pieces based on the previously-downloaded ones, adding latency to the mix. Assuming just…
      paxcoder on HN

Requests

  • Provide Windows and Linux binaries

    From 1 comment
    • How does it only work on macOS if it's based on Node? Seems like they could have gotten it to work on Windows and Linux.
      skrowl on HN
  • Clean up the repository

    From 1 comment
    • The repository seems to contain a lot of garbage (such as an `a.out` file and a `reddit-browser` folder). This look like a really cool project. Could you please clean up the repo…
      JD557 on HN
  • Publish real-world timing measurements

    From 1 comment
    • Is 640KiB not the whole index? Because partial download would mean having to request new pieces based on the previously-downloaded ones, adding latency to the mix. Assuming just…
      paxcoder on HN

Questions

  • How do you know when a query result list is complete?

    From 2 comments
    • Is there indication when the result list for a given query is 'complete'? Otherwise if the search result don't look like what the person wanted, how long should they wait to see…
      degenerate on HN
    • Author here. Yes the SQLite engine returns an SQLITE_OK value when the query is complete, just like if it were a database file on disk. The insight here is that we can tell…
      sktrdie on HN
  • Does a search require downloading the index first?

    From 2 comments
    • Neat, both this and sqltorrent. I'll have to read up on this in more detail... Does this mean you (essentially) need to download the index before doing any searches? Or is there…
      Groxx on HN
    • No you don't need to download the indexes beforehand. The download always starts from the first piece/page (0). From there it essentially performs binary search and only…
      sktrdie on HN

Alternatives named

  • ZeroNet

    From 2 comments
    • This is interesting and reminds me of Zeronet.
      Sunset on HN
    • This is really cool. From the readme it sounds like there's a community of people working on this problem. How much of this is stuff you built from scratch versus libraries you…
      ZainRiz on HN
  • YaCy

    From 1 comment
    • This reminds me a lot of the (I think) very underrated YaCy project: http://yacy.net/en/index.html I know there are a ton of technical reasons why this is difficult, but…
      tombert on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/14130280)