PostgresML
AI
ml in database
SHOW HN2022
Legend
PostgresML
We've been hard at work for a few weeks and thought it's time for another update.
postgresml.org#postgres machine learning#in-database ml#postgresql extension#sql machine learning
How HN took it
15 positive, 33 neutral or asking, 1 mixed, 10 critical, out of 59 comments about the project. Thread score +0.11.
Idea: 9 for, 4 againstDesign: 1 for, 5 againstExecution: 1 for, 1 againstDocs: 2 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Brings ML into the database, avoiding data export
From 2 comments
Seems like a great idea. When you look at many ML frameworks half the code and learning overhead is data schlepping code and table like structures that "reinvent" the schema that…
zmmmmm on HNThis is really cool, running ML workloads on top of SQL is a very practical way of doing ML for a lot of businesses. Many companies don't have the fancy ML workloads like you see…
jdoliner on HN
Training from SQL views is a nice approach
From 2 comments
Cool approach. This nicely fits in the trend of SQL-as-much-as-possible because that makes it just a tiny bit more accessible. Definitely going to play with this in the next few…
thejansen on HNYep! Part of the power of being inside the OLTP is that you can just create a VIEW of your training data, which could be anything from customer purchases, search results,…
montanalow on HN
Objections
Running ML on the primary OLTP database risks resource contention
From 2 comments
Seems like a great idea. When you look at many ML frameworks half the code and learning overhead is data schlepping code and table like structures that "reinvent" the schema that…
zmmmmm on HNIt looks like this is running Python to do the actual ML? There’s nothing stopping you from reading database table structures directly into memory in Python or R now. You don’t…
mr_toad on HN
Logo and name suggest official PostgreSQL affiliation
From 4 comments
You might want to use a different elephant logo... the branding implies that it is an official part of the project. E.g. Postico uses an elephant but not the _same_ elephant -…
properdine on HNYou should review the PostgreSQL trademark policy: https://www.postgresql.org/about/policies/trademarks/
macspoofing on HNThis logo and name, to me at least, implied some sort of official affiliation with the PostgreSQL project. Which I think should at least be clarified on the site/readme.
jmuguy on HNI found this to be very confusing and took some sorting out that this is not an official project of postgresql. I personally think a name change and logo redo is in order here.
pcj-github on HN
Not usable on managed services like RDS due to extension limits
From 1 comment
We can’t control the extensions RDS allows to be installed, and they are historically conservative. Lev and I do have some fairly extensive experience with replication patterns…
montanalow on HN
Requests
Support for managed services like RDS
From 1 comment
Do you plan on adding support for managed PostgreSQL services like RDS in the future?
LunaSea on HN
Support for older Python versions (3.6)
From 1 comment
I just gave it a try to install on Crunchy Bridge [1], disclaimer I work at Crunchy Data. I did this as a standard user vs. anything special about access. I got quite close, but…
craigkerstiens on HN
Cross-validation and hyperparameter search
From 1 comment
Neat project. Any roadmap for cross-validation support (GridSearchCV and friends)?
kipukun on HN
Custom proprietary model support
From 1 comment
is it possible, or how hard is it, to plug in custom proprietary models?
obert on HN
Questions
How does it compare to MADlib and MindsDB
From 2 comments
Hello really nice ! Can you explane the differences with https://madlib.apache.org/ ? Wouldnt an OLAP db better suited than pg for this kind of workload ? Does being a postgreSQL…
waatels on HNHow this compares to https://mindsdb.com/
dayeye2006 on HN
How are train/validation/test splits and metrics handled
From 1 comment
How do you deal with different dataset train/validation/test? How do you measure the degradation of the model? Is there any way to select the metric you target (accuracy,…
jorgemf on HN
Whether GPU training is supported
From 1 comment
This is awesome. I’m guessing the models are executed on the database server and not a separate cluster? What about GPU training? How is that handled? I’d love to see more docs.
gabereiser on HN
Alternatives named
BigQuery ML
From 2 comments
Interesting concept, but I think Big Query ML [1] has been providing similar features for years now. Curious to learn what are the differences, other than offering this as a…
manca on HNThis is great! FYI for those who haven't seen, BigQuery can also run statistical learning methods directly on your data as part of the query. Really cool to see ML going this…
bazhova on HN
MADlib
From 2 comments
Hello really nice ! Can you explane the differences with https://madlib.apache.org/ ? Wouldnt an OLAP db better suited than pg for this kind of workload ? Does being a postgreSQL…
waatels on HNHow about the difference between this and the Madlib project? Better ergonomics? I've used Madlib in the past and although it was 'successful', the constraint was unfamiliarity…
dvasdekis on HN
MindsDB
From 1 comment
How this compares to https://mindsdb.com/
dayeye2006 on HN
Amazon Aurora ML extensions
From 1 comment
Amazon Aurora already has ML extensions for connecting to AWS SageMaker and AWS Comprehend. I doubt they'd add another, especially one they didn't write and isn't integrated with…
ttfkam on HN