Quilt

Data

data package manager

SHOW HN2017

367points
178comments
#43of 2,242 in 2017
Top 2%of 2017 by points

How HN took it

CuriousMostly questions and neutral comments

19 positive, 57 neutral or asking, 1 mixed, 18 critical, out of 95 comments about the project. Thread score +0.08.

Idea: 9 for, 3 againstDesign: 3 for, 2 againstDocs: 2 for, 1 againstPrivacy: 0 for, 3 againstPricing: 0 for, 2 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Parquet conversion and columnar storage are a smart choice.

    From 1 comment
    • I think it was a really interesting (and smart) choice to convert to Parquet format. Columnar storage is so much more efficient, and working with data in Parquet is pretty fast…
      sixdimensional on HN
  • Useful for publishing and sharing public datasets.

    From 2 comments
    • I am a scientist who sometimes publishes data sets with academic papers and this looks super useful both as a tool and as a potential publishing best practice. Currently doing…
      azag0 on HN
    • Awesome idea. Have you thought about a marketplace perhaps? Say for instance I create a package with all the cities in the world or all species of canine, host it in a…
      dawiddutoit on HN

Objections

  • Hard to use with existing data tools; data locked into a walled garden.

    From 1 comment
    • It looks like a plain html page but requires JS to view anything except: "Please enable JavaScript to use this site." What a wonderful time to live in. Anyway, do I get this…
      stewbrew on HN
  • Docs require JavaScript; site not usable without JS.

    From 2 comments
    • It looks like a plain html page but requires JS to view anything except: "Please enable JavaScript to use this site." What a wonderful time to live in. Anyway, do I get this…
      stewbrew on HN
    • Any way your web page could be made viewable without requiring Javascript? I disable it in my web browsers because of security and privacy concerns, and it would be great if I…
      pmoriarty on HN
  • Pricing model questioned.

    From 1 comment
    • I think you're missing a trick with the pricing. My guess is the real money will come once data is treated like a commodity. So the big, big money will be in brokerage's and…
      reggieband on HN

Requests

  • DOI support for dataset versions.

    From 2 comments
    • I am a scientist who sometimes publishes data sets with academic papers and this looks super useful both as a tool and as a potential publishing best practice. Currently doing…
      azag0 on HN
    • Any thoughts on adding DOIs? It's a complex subject wrt versioning, in particular (new DOI per version? How to keep track?). It would help tremendously with the academic…
      torchous on HN
  • GitHub sign-up.

    From 1 comment
    • Is there an option to be able to sign up using Github? That would make life much easier for me.
      forkLding on HN
  • R language support.

    From 1 comment
    • Hi. R is really important to us and we want to add support (probably through SparklyR). If you email me I can add you to our Slack channel and we can talk through extending Quilt…
      akarve on HN
  • Frictionless data spec interop.

    From 1 comment
    • Thanks for releasing. Looks useful and aligned with several projects I've worked on. The first thing I looked for was a canonical package / resource specification in build.py.…
      tzm on HN

Questions

  • How is it different from DAT?

    From 1 comment
    • How is this different/the same as the DAT project (https://datproject.org/ and https://github.com/datproject)?
      fredcash25 on HN
  • Can users run their own instance and is it open source?

    From 1 comment
    • How much of it is open source? Can I run my own?
      ah- on HN
  • How does it compare to git and Pachyderm?

    From 2 comments
    • What does this do that cannot be done with git or similar software + data stored in some standard format?
      fiatjaf on HN
    • This makes me think of http://www.pachyderm.io/. Although Quilt seems to be more like github for data, whereas Pachyderm is more like git for data.
      gouggoug on HN

Alternatives named

  • Git / GitHub

    From 2 comments
    • What does this do that cannot be done with git or similar software + data stored in some standard format?
      fiatjaf on HN
    • It's outrageous how little tooling support there is for version control in data compared to code. Every mainstream database forgets history with updates, don't support…
      smilliken on HN
  • Pachyderm

    From 1 comment
    • This makes me think of http://www.pachyderm.io/. Although Quilt seems to be more like github for data, whereas Pachyderm is more like git for data.
      gouggoug on HN
  • DAT

    From 1 comment
    • How is this different/the same as the DAT project (https://datproject.org/ and https://github.com/datproject)?
      fredcash25 on HN
  • data.world

    From 1 comment
    • This looks like a cool project -- always glad to see new tools for statistical collaboration and reproducible research. How does this compare to what data.world [1] is doing?…
      edraferi on HN
  • Synapse

    From 1 comment
    • I know only a bit about Synapse. It seems like they have some valuable data. I think the biggest differences are in the culture and user experience. Quilt gets its DNA from the…
      akarve on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/14771406)