Sir

Data

embedded json database

SHOW HN2020

115points
50comments
#564of 3,028 in 2020
Top 19%of 2020 by points

How HN took it

CuriousMostly questions and neutral comments

1 positive, 20 neutral or asking, 0 mixed, 0 critical, out of 21 comments about the project. Thread score +0.06.

Idea: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Useful for versioning ML run outputs and similar JSON data

    From 1 comment
    • I generate bunch of JSON data from my machine learning runs (a bunch of outputs for analysis), so this fits my use case perfectly (inspecting changes of different run settings).…
      dijksterhuis on HN

Objections

  • File-based storage has poor performance at scale and concurrent writes can corrupt data without atomic writes

    From 2 comments
    • what's the use case? certainly the performance impact will suffer at scale, so what's the usable limit before disadvantages outweigh the advantages of being able to use git?
      alilsumpinditto on HN
    • I feel like many static site generators have more-or-less filesystem-as-database. Some are more specialized than others. Many SSGs have standardized around the format of `YAML:…
      jitl on HN

Requests

  • Add related projects and examples of database files and diffs

    From 2 comments
    • Could use an example of the database file and diffs. I have vague recollections of a tool that was similarly supposed to make JSON files diffable. IIRC it procedurally built up…
      andreareina on HN
    • Thanks! I'll add to related projects
      graderjs on HN

Questions

  • What is the use case and at what scale does performance suffer

    From 1 comment
    • what's the use case? certainly the performance impact will suffer at scale, so what's the usable limit before disadvantages outweigh the advantages of being able to use git?
      alilsumpinditto on HN

Alternatives named

  • tinydb

    From 1 comment
    • This is sort of in the space: https://github.com/msiemens/tinydb
      LVB on HN
  • recutils

    From 1 comment
    • There's always recutils [0] which uses a plain text database format stored in files called recfiles. [0] https://labs.tomasino.org/gnu-recutils/
      asaibx on HN
  • gron

    From 1 comment
    • This is called gron, I prefer it for reading JSON with a lot of nesting. https://github.com/tomnomnom/gron
      PowerfulWizard on HN
  • sqlite-diffable

    From 1 comment
    • I wrote a tool that dumps a SQLite database out to disk as diffable JSON, precisely so you can easily record changes made to the database over time:…
      simonw on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/25004554)