[{"data":1,"prerenderedAt":349},["ShallowReactive",2],{"project-46108557":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":36,"aspects":37,"strip":44,"post_text":45,"what":46,"said":72,"maker_in_thread":175,"shape":177,"grid":182,"attempts":312,"same_week":313,"maker_shows":39,"maker_hidden":341,"reader_version":342,"card":343},"46108557","Walrus","a Kafka alternative written in Rust","title","Show HN: Walrus – a Kafka alternative written in Rust","https:\u002F\u002Fgithub.com\u002Fnubskr\u002Fwalrus","github.com","janicerk",1764602893,2025,160,48,446,3837,12,"notable","infrastructure","distributed log \u002F message streaming","library",[24,25,26,27,28],"kafka alternative","rust","distributed log","write-ahead log","message streaming","mixed",-0.097,{"positive":32,"neutral":33,"mixed":34,"critical":35},3,7,0,5,15,{"idea":38,"execution":40,"docs":42,"performance":43},{"positive":39,"critical":32},2,{"positive":41,"critical":41},1,{"positive":34,"critical":34},{"positive":34,"critical":41},[35,34,34,34,34,34,34,41,35,32,34,32,32,34,34,34,34,34,34,34,32,41,34,34,34,34,34,34,34,32,41,34,34,34,41,41,32,35,34,32],null,{"problem":47,"audience":45,"pricing":45,"motivation":45,"time_to_build":45,"stack":55,"openness":71,"stage":71,"team_size":71},{"value":48,"source":49,"evidence":50},"Running a full Kafka stack is operationally heavy; offers a simpler, fast log","commenter",[51],{"id":52,"by":53,"text":54},"46148005","Barathkanna","Walrus isn’t trying to replace Kafka, but it does beat Kafka in a few narrow areas. It’s a lightweight Rust-based distributed log with a fast WAL engine and modern I\u002FO…",[56,60,64],{"value":57,"source":49,"evidence":58},"Rust",[59],{"id":52,"by":53,"text":54},{"value":61,"source":49,"evidence":62},"io_uring",[63],{"id":52,"by":53,"text":54},{"value":65,"source":49,"evidence":66},"Raft (metadata coordination)",[67],{"id":68,"by":69,"text":70},"46146310","seanhunter","It says on the github page ``` \" It provides fault-tolerant streaming with automatic leadership rotation, segment-based partitioning, and Raft consensus for metadata…","unknown",{"praise":73,"objections":85,"requests":108,"questions":128,"alternatives":137},[74,78],{"value":75,"source":49,"evidence":76},"Fast, lightweight, easier to run than Kafka",[77],{"id":52,"by":53,"text":54},{"value":79,"source":49,"evidence":80},"Simplified API",[81],{"id":82,"by":83,"text":84},"46146020","roncohen","As someone who myself worked on a hobby-level Rust based Kafka alternative that used Raft for metadata coordination for ~8 months: nice work! Wasn't immediately clear to me if…",[86,94,101],{"value":87,"source":49,"evidence":88},"Data plane replication and fault tolerance unclear for a single-node write path",[89,93],{"id":90,"by":91,"text":92},"46240267","aaronrobert","It seems that the data is written to only a single node. But if that's the case, how is fault-tolerant ensured? In terms of data synchronization, how is this different from…",{"id":82,"by":83,"text":84},{"value":95,"source":49,"evidence":96},"No recovery of redundancy after node failure mentioned",[97],{"id":98,"by":99,"text":100},"46208467","yencabulator","I see no mention of recovering redundancy of stored data after a node failure.",{"value":102,"source":49,"evidence":103},"Benchmarks lack p99 latency and use custom rather than standard benchmarks",[104],{"id":105,"by":106,"text":107},"46147374","chaotic-good","I don't see any mentions of p99 latency in the benchmark results. Pushing gigabytes per second is not that difficult on modern hardware. Doing so with reasonable latency is…",[109,113,117],{"value":110,"source":49,"evidence":111},"Kafka-compatible API",[112],{"id":82,"by":83,"text":84},{"value":114,"source":49,"evidence":115},"S3-backed storage mode (diskless or tiered)",[116],{"id":82,"by":83,"text":84},{"value":118,"source":49,"evidence":119},"Compare against Redpanda",[120,124],{"id":121,"by":122,"text":123},"46146630","teleforce","For Kafka alternative written in C++ there's Redpanda [1],[2]. Redpanda claim of better performance but benchmarks showed no clear winner [3]. It will be interesting to test them…",{"id":125,"by":126,"text":127},"46146853","nubskr","In the current benchmarks, I only have Kafka and rocksdb wal, will surely try to add redpanda there as well, curious how walrus would hold up against seastar based systems.",[129,133],{"value":130,"source":49,"evidence":131},"How is data-plane replication handled, Raft or home-rolled?",[132],{"id":82,"by":83,"text":84},{"value":134,"source":49,"evidence":135},"How is fault tolerance ensured if data is written to one node?",[136],{"id":90,"by":91,"text":92},[138,146,153,160,168],{"value":139,"source":49,"evidence":140},"Redpanda",[141,142],{"id":121,"by":122,"text":123},{"id":143,"by":144,"text":145},"46152084","alexmorley","IMO for those requirements Redpanda has been the go-to for the last 5 years or so but I agree this is still a nice take and potentially even lighter.",{"value":147,"source":49,"evidence":148},"Tansu",[149],{"id":150,"by":151,"text":152},"46149361","enether","For Rust-based Kafka alternatives, I like Tansu[1]. It at least provides Kafka API parity, and critically also gives users a pluggable backend (embedded SQLite, S3 for low cost…",{"value":154,"source":49,"evidence":155},"Apache Iggy",[156],{"id":157,"by":158,"text":159},"46146250","k_bx","There's also Iggy https:\u002F\u002Fgithub.com\u002Fapache\u002Figgy Never tried it, but looks promising",{"value":161,"source":49,"evidence":162},"WarpStream",[163,164],{"id":150,"by":151,"text":152},{"id":165,"by":166,"text":167},"46148356","zellyn","The Developer Voices interview where Kris Jenkins talks to Ryan Worl is one of the best, and goes into a surprising amount of detail: https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=xgzmxe6cj6A…",{"value":169,"source":49,"evidence":170},"NATS",[171],{"id":172,"by":173,"text":174},"46146558","oulipo2","Nice! How does it compare to Redpanda, NATS, etc?",{"comments":34,"answered":34,"key":176},[],{"commenters":178,"max_depth":179,"maker_replies":34,"first_comment_mins":180,"lifespan_hours":181},38,6,4028,251,[183,185,187,191,194,196,199,202,205,207,209,211,214,217,220,223,224,226,228,230,232,235,238,242,243,245,247,249,252,255,258,261,264,266,268,270,271,274,278,281,284,287,290,294,299,300,303,308],[52,34,35,184,53,34],"project\u002Fpositive\u002Fidea",[143,34,34,186,144,34],"commenter\u002Fneutral\u002Fnone",[188,41,34,189,190,34],"46146700","other\u002Fneutral\u002Fnone","lionkor",[192,41,34,189,193,34],"46146991","sgt",[195,41,34,189,190,34],"46147229",[197,41,34,189,198,34],"46147622","ramses0",[200,41,34,189,201,34],"46149803","kylecazar",[203,41,34,189,204,34],"46164242","dbacar",[150,39,41,206,151,34],"project\u002Fcritical\u002Fidea",[82,32,35,208,83,34],"maker\u002Fpositive\u002Fexecution",[68,32,32,210,69,34],"project\u002Fneutral\u002Fdocs",[212,32,34,186,213,34],"46146608","zbentley",[215,32,34,186,216,34],"46147006","EdwardDiego",[218,32,32,219,126,34],"46146839","maker\u002Fneutral\u002Fexecution",[221,32,32,222,216,34],"46146950","project\u002Fneutral\u002Fexecution",[165,32,34,189,166,34],[225,32,34,189,126,34],"46148501",[227,32,34,189,166,34],"46149191",[229,32,34,189,216,34],"46185012",[157,231,34,189,158,34],4,[233,231,34,189,234,34],"46147182","tormeh",[236,231,34,189,237,34],"46149049","spetz",[239,231,34,240,241,34],"46149266","other\u002Fpositive\u002Fnone","carverauto",[121,35,34,189,122,34],[125,35,32,244,126,34],"maker\u002Fneutral\u002Fperformance",[105,35,41,246,106,34],"project\u002Fcritical\u002Fperformance",[248,35,34,189,216,34],"46146985",[250,35,34,189,251,34],"46149089","thinkharderdev",[253,35,34,189,254,34],"46148246","drob518",[256,35,34,189,257,34],"46151720","jeberle",[259,35,34,189,260,34],"46152137","pixelpoet",[262,35,34,189,263,34],"46165866","selkin",[265,35,34,189,260,34],"46168341",[267,35,34,189,263,34],"46168733",[269,35,34,189,260,34],"46169166",[90,179,32,222,91,34],[272,33,41,206,273,34],"46156856","throw10920",[275,276,34,189,277,34],"46147910",8,"gethly",[279,276,34,189,280,34],"46148472","sumtechguy",[282,276,34,189,283,34],"46148762","mrkeen",[285,276,34,189,286,34],"46168613","lucyjojo",[98,288,41,289,99,34],9,"project\u002Fcritical\u002Fexecution",[291,292,41,206,293,34],"46175405",10,"optician_owl",[295,296,32,297,298,34],"46149843",11,"project\u002Fneutral\u002Fperformance","WD-42",[172,18,35,184,173,34],[301,18,34,189,302,34],"46150547","Zambyte",[304,305,32,306,307,34],"46156677",13,"project\u002Fneutral\u002Fidea","Natfan",[309,310,34,189,311,34],"46148251",14,"ertucetin",[],[314,319,324,329,334,338],{"id":315,"name":316,"points":317,"category":318},"46093473","Boing",782,"games",{"id":320,"name":321,"points":322,"category":323},"46075882","banrays",509,"security_privacy",{"id":325,"name":326,"points":327,"category":328},"46139761","finfam",393,"finance_crypto",{"id":330,"name":331,"points":332,"category":333},"46135067","Fresh",187,"dev_tools",{"id":335,"name":336,"points":337,"category":333},"46090619","Nano PDF",176,{"id":339,"name":340,"points":337,"category":328},"46130260","HCB Mobile",false,"v2",{"id":344,"name":5,"line":6,"ai":341,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":345,"top":18,"kw":346,"maker":11,"domain":10,"tier":19,"attempts":34,"strip":347,"url":9,"mix":348,"praise":75,"objection":87,"sub":21},46108557,-0.1,[24,25,26,27,28],"5000000153033000000031000000031000113503",[32,33,34,35],1794036686665]