Superintendent
Data
csv sql query tool
SHOW HN2021
99points
61comments
#533of 2,533 in 2021
Top 22%of 2021 by points
How HN took it
DebatedReal support and real criticism
5 positive, 6 neutral or asking, 1 mixed, 4 critical, out of 16 comments about the project. Thread score -0.03.
Idea: 4 for, 3 againstExecution: 1 for, 0 againstDocs: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Fast on large files
From 2 comments
Great to see SQL being used more for such use cases! (I really like SQL) This looks nice, especially with the charting! It's good to know though that there are a few similar open…
cube2222 on HNI use the command line all day, it definitely has its place. But trying to manipulate large CSV files has never felt like a good fit for the CLI. I'm already using and enjoying…
qorrect on HN
Useful GUI for SQL on CSV for analysts
From 2 comments
It's the inbetweeners that's the ideal target audience. Analysts (including me a few years back) that knows SQL (through Tableau/BigQuery), but don't know how to get comfortable…
raihansaputra on HNYeah, I don't know whether this is new or not, but there's a lot of positions that are supported by their data teams to be able to do SQL queries for their business needs but not…
raihansaputra on HN
Join support for CSVs
From 1 comment
I like that this lets you join CSVs, which a lot of tools in this space don’t.
mjirv on HN
Objections
Command line tools already do this with SQLite
From 3 comments
Seems useful but at the same time it's comparison with loading CSV into SQL seems kind of disingenuous since if you're familiar with SQL you're probably familiar with command…
rognjen on HNThis open source tool on Github allows you to quickly import a CSV and write SQL queries against it. The CSV is imported into a SQLite database. It also does a lot more, highly…
EMM_386 on HNI do this already with sqlite3
gigatexal on HN
Comparison with loading CSV into SQL is misleading
From 1 comment
Seems useful but at the same time it's comparison with loading CSV into SQL seems kind of disingenuous since if you're familiar with SQL you're probably familiar with command…
rognjen on HN
Target audience unclear
From 1 comment
So its a GUI wrapper around sqlite. I guess I expect data scientists and engineers to be comfortable with command line and scripting, and there are GUIs that will work with…
jonnycomputer on HN
Requests
Open source the project
From 1 comment
Why isn't this opensourced?
dantetheinferno on HN
Support DuckDB-style dialect features like WITH RECURSIVE
From 1 comment
Hi! I'm the OP here. The performance gain is mainly from reading/writing files in C and/or by Sqlite (which is also C). Any other tool that use dynamic languages like python will…
tanin on HN
Questions
Why is it not open source
From 1 comment
Why isn't this opensourced?
dantetheinferno on HN
Whether it is faster than Python or pandas on large files
From 2 comments
> A python script loading a 1GB file is likely to take more than 1 minutes on any machine. Since when? I just tested it, and I can process a 1gb CSV file on my machine using the…
banana_giraffe on HNThis is OP, but that is amazing. I tried reading 1GB CSV and add all the rows into Sqlite, and it definitely takes minutes. This happens to both JS and python. Constructing a…
tanin on HN
Alternatives named
DuckDB
From 2 comments
Checkout the R bindings for DuckDB[0]. You should find that it does the same thing (i.e. run SQL against a dataframe/file on disk) much faster for many SQL operations. [0]…
RobinL on HNDuckDB is a newer but much faster alternative that lets you run SQL on csv files (and also directories of parquet files etc.) It's so fast/good that I've actually been using it…
RobinL on HN
q
From 2 comments
Great to see SQL being used more for such use cases! (I really like SQL) This looks nice, especially with the charting! It's good to know though that there are a few similar open…
cube2222 on HNIs this similar to https://github.com/harelba/q ?
_1tan on HN
Datasette
From 2 comments
Great to see SQL being used more for such use cases! (I really like SQL) This looks nice, especially with the charting! It's good to know though that there are a few similar open…
cube2222 on HNThe datasette author offers this tool for conversion: https://github.com/simonw/csvs-to-sqlite
hprotagonist on HN
sqlitebrowser
From 1 comment
This open source tool on Github allows you to quickly import a CSV and write SQL queries against it. The CSV is imported into a SQLite database. It also does a lot more, highly…
EMM_386 on HN
pandasql
From 1 comment
Cool tool! Panda SQL is great for doing SQL on pandas dataframes. https://pypi.org/project/pandasql/
beckingz on HN
TextQL
From 1 comment
Great to see SQL being used more for such use cases! (I really like SQL) This looks nice, especially with the charting! It's good to know though that there are a few similar open…
cube2222 on HN