[{"data":1,"prerenderedAt":322},["ShallowReactive",2],{"project-37571974":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":36,"aspects":37,"strip":43,"post_text":46,"what":47,"said":79,"maker_in_thread":192,"shape":203,"grid":207,"attempts":284,"same_week":285,"maker_shows":243,"maker_hidden":314,"reader_version":315,"card":316},"37571974","Hydra","Open-Source Columnar Postgres","title","Show HN: Hydra - Open-Source Columnar Postgres","https:\u002F\u002Fwww.hydra.so\u002Fblog-posts\u002Fhydra-1-generally-available","hydra.so","coatue",1695139507,2023,122,33,519,3109,17,"notable","data","postgres extension","library",[24,25,26,27,28],"postgres","columnar storage","analytics","aggregate queries","olap","curious",-0.103,{"positive":32,"neutral":33,"mixed":34,"critical":35},2,16,1,6,25,{"idea":38,"execution":39,"design":41,"docs":42},{"positive":34,"critical":34},{"positive":40,"critical":40},0,{"positive":40,"critical":40},{"positive":40,"critical":40},[44,40,45,45,45,44,40,34,34,40,40,34,34,34,45,40,45,45,45,34,40,45,45,40,45,45,45,45,45,45,45,40,45],5,3,"hi hn, hydra ceo here\n\nhydra is an open-source extension that adds columnar tables to Postgres for efficient analytical reporting. With Hydra, you can analyze billions of rows instantly without changing code.\n\ndemo video (5 min): https:\u002F\u002Fyoutu.be\u002F1yzxgb0Oyrw\ngithub repo: https:\u002F\u002Fgithub.com\u002Fhydradatabase\u002Fhydra\n\nFor 1.0 GA release, aggregate queries are over *60% faster* than Hydra beta due to aggregate vectorization. Spatial indexes (gin, gist, spgist, and rum indexes) and pg_hint_plan are now enabled for performance optimization.\n\npostgres is great, but aggregates can take minutes to hours to ",{"problem":48,"audience":54,"pricing":55,"motivation":54,"time_to_build":54,"stack":59,"openness":76,"stage":77,"team_size":78},{"value":49,"source":50,"evidence":51},"Aggregate queries on large Postgres datasets take minutes to hours and hog database resources","maker",[52],{"id":53},"post",null,{"value":56,"source":50,"evidence":57},"Free tier on Hydra cloud",[58],{"id":53},[60,64],{"value":61,"source":50,"evidence":62},"PostgreSQL",[63],{"id":53},{"value":65,"source":66,"evidence":67},"Citus","commenter",[68,72],{"id":69,"by":70,"text":71},"37578362","efxhoy","Big congrats on 1.0! Super exciting project. My dream scenario would be installing hydra as an extension into my main rails application database. My usecase is showing analytics…",{"id":73,"by":74,"text":75},"37579037","wuputah","Thanks for calling these out, as these are just misunderstandings. We will certainly tweak the language around these. - Installing the extension itself does not change the…","open_source","launched","company",{"praise":80,"objections":100,"requests":126,"questions":149,"alternatives":177},[81,92],{"value":82,"source":66,"evidence":83},"Useful for slow analytical aggregates on Postgres without adding another database",[84,88],{"id":85,"by":86,"text":87},"37577516","mlenhard","Congrats on the 1.0 Release, big milestone. I'm personally really excited about all of the recent tooling for postgres aggregates. Definitely a pain point for a lot of developers…",{"id":89,"by":90,"text":91},"37572437","garysahota93","I've been using Hydra for the last ~2 months & genuinely love it. The team is really talented & it's so great to see the progress they've been making. Congrats on the 1.0 GA…",{"value":93,"source":66,"evidence":94},"Congratulations on the 1.0 GA release",[95,96],{"id":89,"by":90,"text":91},{"id":97,"by":98,"text":99},"37576533","pella","Congratulations! Please also add this info : #1. to the pgsql-announce list: https:\u002F\u002Fwww.postgresql.org\u002Fsearch\u002F?m=1&ln=pgsql-announce&q=hydra \"Your search for hydra returned no…",[101,112,117,122],{"value":102,"source":66,"evidence":103},"Name collides with existing Hydra projects and trademarks",[104,108],{"id":105,"by":106,"text":107},"37575598","iepathos","Nice tool, only unfortunate name, consider changing it. Already very well know security tool named hydra https:\u002F\u002Fgithub.com\u002Fvanhauser-thc\u002Fthc-hydra been around since 2001. Then…",{"id":109,"by":110,"text":111},"37578125","adultSwim","Watch out. There used to be another Hydra project, a data repository with rich linked metadata, that changed its name after legal threat over trademark from Hydra Corporation.…",{"value":113,"source":66,"evidence":114},"Extension changes default table type, which was a misunderstanding per maker",[115,116],{"id":69,"by":70,"text":71},{"id":73,"by":74,"text":75},{"value":118,"source":66,"evidence":119},"Postgres foreign data wrapper features rebranded as Hydra External Tables",[120,121],{"id":69,"by":70,"text":71},{"id":73,"by":74,"text":75},{"value":123,"source":66,"evidence":124},"Citus fork not disclosed clearly in FAQ",[125],{"id":69,"by":70,"text":71},[127,138,142],{"value":128,"source":66,"evidence":129},"Clarify docs on update and delete support in columnar tables",[130,134],{"id":131,"by":132,"text":133},"37577044","gregwebs","> Whenever possible, design data coming into the data warehouse as append-only. Hydra's columnar store only supports inserts. If you need to update or delete data, you will need…",{"id":135,"by":136,"text":137},"37577123","jerrysievert","that is not the case at this point. updates, deletes, and vacuuming are all available.",{"value":139,"source":66,"evidence":140},"Add Hydra to pgsql-announce and planet.postgresql.org",[141],{"id":97,"by":98,"text":99},{"value":143,"source":66,"evidence":144},"Clarify license files in repo",[145],{"id":146,"by":147,"text":148},"37579568","mdaniel","some previous discussions: https:\u002F\u002Fnews.ycombinator.com\u002Fitem?id=37247945 https:\u002F\u002Fnews.ycombinator.com\u002Fitem?id=36987920 and a relevant observation is that there are actually…",[150,157,163,170],{"value":151,"source":66,"evidence":152},"How to keep heap and columnar tables in sync in real time",[153],{"id":154,"by":155,"text":156},"37576401","cjonas","What's the workflow for leveraging this extension in real-time for an existing database? Say I wanted to use this to create a high performance \"aggregation\" API of my existing…",{"value":158,"source":66,"evidence":159},"How to add the extension to a Postgres Dockerfile",[160],{"id":161,"by":70,"text":162},"37586222","> - Installing the extension itself does not change the default table type, this is only the case on Hydra Cloud and our Docker image. Ah cool, thanks! How would I go about…",{"value":164,"source":66,"evidence":165},"Whether it works on Azure Flexible Server for Postgres",[166],{"id":167,"by":168,"text":169},"37576974","I_am_tiberius","I have 2 questions. 1. Is this optimized for constantly adding and removing rows to the columnar table? 2. Is this supported by Microsoft Azure Flexible Server for Postgres?",{"value":171,"source":66,"evidence":172},"How sharding works and whether it works with Citus",[173],{"id":174,"by":175,"text":176},"37580295","winrid","How does sharding work? Can I use this with citus to scale horizontally?",[178,184,188],{"value":179,"source":66,"evidence":180},"ZomboDB",[181],{"id":182,"by":132,"text":183},"37579654","You could use ETL tools like peerdb.io. This isn't \"real time\" but instead some refresh interval. ZomboDB uses ElasticSearch as an index that is transactionally consistent with…",{"value":185,"source":66,"evidence":186},"PeerDB",[187],{"id":182,"by":132,"text":183},{"value":189,"source":66,"evidence":190},"TimescaleDB",[191],{"id":69,"by":70,"text":71},{"comments":44,"answered":40,"key":193},[194,197,200],{"id":195,"text":196},"37573371","Thank you!",{"id":198,"text":199},"37575850","I was thinking X.com - is it available?",{"id":201,"text":202},"37576898","Should have mentioned, if you want to chat about open source, analytics, or meet some of the Hydra team swing by our event in SF this Thursday:…",{"commenters":204,"max_depth":44,"maker_replies":44,"first_comment_mins":205,"lifespan_hours":206},22,29,24,[208,210,214,216,218,219,221,223,225,228,230,233,236,239,242,245,247,249,250,252,254,257,259,263,265,267,268,269,271,273,275,279,282],[85,40,44,209,86,40],"project\u002Fpositive\u002Fidea",[211,40,40,212,213,40],"37578068","commenter\u002Fneutral\u002Fnone","MuffinFlavored",[154,34,45,215,155,40],"project\u002Fneutral\u002Fexecution",[217,34,45,215,136,40],"37577102",[182,34,45,215,132,40],[89,32,44,220,90,40],"project\u002Fpositive\u002Fnone",[195,32,40,222,11,34],"maker\u002Fpositive\u002Fnone",[105,45,34,224,106,40],"project\u002Fcritical\u002Fnone",[226,45,34,224,227,40],"37575688","cultofmetatron",[198,45,40,229,11,34],"other\u002Fneutral\u002Fnone",[231,45,40,229,232,40],"37579029","re-thc",[234,45,34,224,235,40],"37576158","robertlagrant",[237,45,34,224,238,40],"37576339","hamoid",[240,45,34,224,241,40],"37579763","metadat",[69,243,45,244,70,40],4,"project\u002Fmixed\u002Fdesign",[246,243,40,212,136,40],"37578997",[73,243,45,248,74,40],"project\u002Fneutral\u002Fdocs",[161,243,45,248,70,40],[97,44,45,251,98,40],"project\u002Fneutral\u002Fnone",[109,35,34,253,110,40],"project\u002Fcritical\u002Fidea",[201,255,40,256,11,34],7,"maker\u002Fneutral\u002Fnone",[146,258,45,248,147,40],8,[260,261,45,256,262,40],"37579358",9,"nitinreddy88",[264,261,40,256,11,34],"37579668",[167,266,45,215,168,40],10,[131,266,45,248,132,40],[135,266,45,248,136,40],[270,266,45,248,132,40],"37578987",[272,266,45,248,136,40],"37579006",[274,266,45,215,136,40],"37577162",[276,277,45,248,278,40],"37576393",11,"giovannibonetti",[280,277,40,281,11,34],"37576637","maker\u002Fneutral\u002Fdocs",[174,283,45,215,175,40],12,[],[286,291,295,300,305,310],{"id":287,"name":288,"points":289,"category":290},"37558357","HyperDX",722,"infrastructure",{"id":292,"name":293,"points":294,"category":20},"37584049","ElectricSQL",617,{"id":296,"name":297,"points":298,"category":299},"37507419","Nue",370,"languages",{"id":301,"name":302,"points":303,"category":304},"37538028","Every Breath You Take",348,"learning_science",{"id":306,"name":307,"points":308,"category":309},"37583219","SeaGOAT",240,"dev_tools",{"id":311,"name":312,"points":313,"category":309},"37533493","exaequOS",216,false,"v2",{"id":317,"name":5,"line":6,"ai":314,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":318,"top":18,"kw":319,"maker":11,"domain":10,"tier":19,"attempts":40,"strip":320,"url":9,"mix":321,"praise":82,"objection":102,"sub":21},37571974,-0.1,[24,25,26,27,28],"503335011001113033310330333333303",[32,33,34,35],1794036641972]