OctoSQL

A great motivation and keeping it simple from an interface perspective is a cool intention. It's a great start with tons of directions you can take it, and many interesting…

Thanks for sharing. This is cool, just what I wanted. I like the fact I can create config files and query not just he database but also query JSON.

Thanks! We only support reads, and for now we're not planning to add write support. You can use the csv output format though and later import that somewhere.

Hey, sorry for the late response, currently totally inefficient - scan whole file each time. We plan on adding an in memory or on disk index for such cases.

> commandline tool allowing me to join data from different places, without needing to set up stuff like presto or spark. On another hand, I never encountered any tool which…

Yeah an Drill has been around for a few years. Will likely continue to use Drill over octocat (no offense OP)

Thanks! 1. Initially we wanted to do one table per config-entry, but that'll be an easy to do UX improvement. 2. We're planning to add support for piping the csv/json file…

This is great. I keep the following in my bash profile for querying CSVs with SQL, which works OK, but this is probably better: ``` function csv_to_sqlite() { echo "used as…

Consider adding a server/daemon with jobs and scheduling. This would let people copy and reconcile data between systems, or prep data at night, etc... It could also save indexes…

Pretty cool stuff. Does it support writing to (single) data sources too or only reading queries?

When joining tables from 2 different data sources, is the join performed by loading two tables in full into memory ? If yes - any plans on improving this, so that it does not OOM…

> commandline tool allowing me to join data from different places, without needing to set up stuff like presto or spark. On another hand, I never encountered any tool which…

Cool project. On a side note, Apache Drill (https://drill.apache.org/) is also worth checking out. The homepage doesn't make it very apparent, but I've used it to query CSVs,…

Generally, I make use of file_fdw module of Postgres to achieve this. https://www.postgresql.org/docs/11/file-fdw.html

Postgres Foreign Data Wrappers are an incredibly powerful tool. I've in the past built a basic data warehouse for a distributed system by pulling in read slaves from assorted…

Really cool, thanks for sharing. You all might want to look at Apache Calcite (http://calcite.apache.org/) as well for inspiration, which has similar functionality as a subset of…

Really nice! Something similar (with a GUI) is https://www.dremio.com/ that I think has gained some traction.

"Sqawk is an Awk-like program that uses SQL and can combine data from multiple files. It is powered by SQLite." https://github.com/dbohdan/sqawk