[{"data":1,"prerenderedAt":347},["ShallowReactive",2],{"project-24119113":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":34,"aspects":35,"strip":41,"post_text":42,"what":43,"said":75,"maker_in_thread":163,"shape":173,"grid":178,"attempts":311,"same_week":312,"maker_shows":32,"maker_hidden":340,"reader_version":341,"card":342},"24119113","Jet","in-memory, fault-tolerant, distributed stream processing","title","Show HN: Jet – in-memory, fault-tolerant, distributed stream processing","https:\u002F\u002Fgithub.com\u002Fhazelcast\u002Fhazelcast-jet","github.com","cangencer",1597144096,2020,129,55,486,3028,17,"notable","data","stream processing","library",[21,24,25,26],"distributed computing","in-memory","fault tolerant","curious",-0.1,{"positive":30,"neutral":31,"mixed":32,"critical":33},0,15,1,3,19,{"execution":36,"privacy":37,"performance":38,"idea":39,"pricing":40},{"positive":30,"critical":30},{"positive":30,"critical":33},{"positive":30,"critical":30},{"positive":30,"critical":30},{"positive":30,"critical":30},[33,30,30,30,30,30,30,32,30,30,30,30,30,30,30,32,33,30,32,30,30,30,30,30,30,30,30,33,33,33,33,33,30,33,33,30,33,33,30,33],null,{"problem":44,"audience":42,"pricing":52,"motivation":42,"time_to_build":42,"stack":59,"openness":72,"stage":73,"team_size":74},{"value":45,"source":46,"evidence":47},"Processing high-throughput, large-state streaming data across a cluster","commenter",[48],{"id":49,"by":50,"text":51},"24130896","haxen","This statement comes from our benchmarking work: https:\u002F\u002Fjet-start.sh\u002Fblog\u002F2020\u002F06\u002F09\u002Fjdk-gc-benchmarks-part1 The point is that Jet can track several million distinct keys, even…",{"value":53,"source":54,"evidence":55},"Apache 2 core, community license for connectors; free to use and embed","maker",[56],{"id":57,"by":11,"text":58},"24130257","The license is meant to prevent service-wrapping by cloud providers, other than that it doesn't have any implications for standard usage. The core library \u002F server is Apache 2…",[60],{"value":61,"source":62,"evidence":63},"Java","inferred",[64,68],{"id":65,"by":66,"text":67},"24133319","liminal","I'm a bit surprised all these systems continue to be built on the JVM. For these sorts of tasks I'd expect something without a VM like Rust to be a better choice",{"id":69,"by":70,"text":71},"24130782","netgusto","Very cool! Is it possible to mix apis in a single project with Jet Beam Runner? This would make it easier to port Beam projects to Jet, as the migration could be progressive.","open_source","launched","company",{"praise":76,"objections":90,"requests":109,"questions":117,"alternatives":136},[77,83],{"value":78,"source":54,"evidence":79},"Built-in fault tolerance without external coordination systems",[80],{"id":81,"by":11,"text":82},"24130858","While Flink is a fully-featured stream processing framework I think there's some notable differences. Off the top of my mind: - Flink uses Zookeeper for metadata and…",{"value":84,"source":54,"evidence":85},"Lightweight cooperative threading allows many concurrent jobs",[86,87],{"id":81,"by":11,"text":82},{"id":88,"by":11,"text":89},"24141137","This is indeed a question that we get asked a lot. We have so far not though about adding more advanced scheduling capabilities for the cooperative threads. With the slot system,…",[91,98],{"value":92,"source":46,"evidence":93},"Commenter had bad experience with Hazelcast consistency bugs",[94],{"id":95,"by":96,"text":97},"24131440","davewritescode","Jet looks really cool, I'll but I think we'll stick with Flink for the time being. I say this as someone who got burned hard with weird bugs using Hazelcast 2.X as distributed…",{"value":99,"source":46,"evidence":100},"Tracking GPS locations of users raises privacy concerns",[101,105],{"id":102,"by":103,"text":104},"24130768","jmnicolas",">High-throughput, large-state stream processing. For example, tracking GPS locations of millions of users, inferring their velocity vectors. It baffles me they're so casual about…",{"id":106,"by":107,"text":108},"24131311","kgraves","Which is still a disgusting and unethical use of technology.",[110],{"value":111,"source":46,"evidence":112},"Python API",[113],{"id":114,"by":115,"text":116},"24130470","grillorafael","This has ways to handle all the problems i currently manually implement. Any idea of getting a python api ?",[118,129],{"value":119,"source":46,"evidence":120},"How does it compare to Kafka Streams and Apache Beam",[121,125],{"id":122,"by":123,"text":124},"24131402","victor106","I am new to this space. So Sorry if this is not a valid comparison. But how does this compare to Kafka?",{"id":126,"by":127,"text":128},"24130553","forgotmyhnacc","How does this compare to Apache beam?",{"value":130,"source":46,"evidence":131},"What does SQL support look like",[132],{"id":133,"by":134,"text":135},"24131421","Aeolun","I’m not really sure how to imagine SQL support for something like this. Can you point me anywhere that will give me a better idea?",[137,145,149,156],{"value":138,"source":46,"evidence":139},"Apache Flink",[140,144],{"id":141,"by":142,"text":143},"24130637","KptMarchewa","Why not use Apache Flink?",{"id":95,"by":96,"text":97},{"value":146,"source":46,"evidence":147},"Apache Beam",[148],{"id":126,"by":127,"text":128},{"value":150,"source":46,"evidence":151},"Kafka Streams",[152],{"id":153,"by":154,"text":155},"24132030","dominotw","compares to kafka streams which is built on top of kafka.",{"value":157,"source":46,"evidence":158},"Spark and Storm",[159],{"id":160,"by":161,"text":162},"24130950","loremipsium","spark, storm, flink, beam, hazelcast... and then there are all the vendor locked choices confluent, kinesis, azure probably has something in that space to The whole cloud…",{"comments":164,"answered":164,"key":165},7,[166,169,172],{"id":167,"text":168},"24131049","This is very true. Stream processing is both old and new and I think it takes time for technology like this to really mature. There's currently a standardisation effort around…",{"id":170,"text":171},"24145086","The paper is part of the standardization effort but is not the final authority on the process. It is a very good reference on how to approach streaming SQL, even though the Jet…",{"id":57,"text":58},{"commenters":174,"max_depth":175,"maker_replies":164,"first_comment_mins":176,"lifespan_hours":177},35,9,1375,53,[179,181,185,189,190,192,195,197,200,203,205,208,211,214,218,221,224,227,230,233,236,238,241,244,247,248,251,253,256,258,261,263,265,267,269,272,274,277,278,280,282,286,287,289,293,294,295,297,298,301,303,304,305,307,310],[95,30,33,180,96,30],"project\u002Fmixed\u002Fexecution",[182,30,30,183,184,30],"24131751","commenter\u002Fneutral\u002Fexecution","jerrinot",[186,30,30,187,188,30],"24132212","other\u002Fneutral\u002Fnone","drej",[160,32,30,187,161,30],[167,32,30,191,11,32],"commenter\u002Fneutral\u002Fnone",[193,32,30,187,194,30],"24133422","chrisjc",[170,32,30,196,11,32],"project\u002Fneutral\u002Fnone",[198,32,30,187,199,30],"24131436","imglorp",[201,32,30,187,202,30],"24131808","nwsm",[204,32,30,187,199,30],"24131984",[102,206,32,207,103,30],2,"project\u002Fcritical\u002Fprivacy",[209,206,30,210,70,30],"24130794","commenter\u002Fneutral\u002Fprivacy",[212,206,30,210,213,30],"24130837","onion2k",[215,206,30,216,217,30],"24130886","other\u002Fneutral\u002Fprivacy","uryga",[219,206,30,216,220,30],"24130887","volgar1x",[222,206,30,216,223,30],"24130932","frant-hartm",[225,206,30,216,226,30],"24131035","T-A",[228,206,30,187,229,30],"24131314","cbluth",[231,206,30,216,232,30],"24132051","Spivak",[234,206,30,216,235,30],"24132605","jccooper",[49,206,33,237,50,30],"project\u002Fneutral\u002Fperformance",[239,206,32,240,103,30],"24131500","maker\u002Fcritical\u002Fprivacy",[242,206,33,243,50,30],"24131674","project\u002Fneutral\u002Fprivacy",[245,206,30,216,246,30],"24131099","rswail",[106,206,32,207,107,30],[249,206,30,210,250,30],"24131360","kittiepryde",[252,206,30,216,107,30],"24134887",[254,206,30,216,255,30],"24131369","t0mas88",[257,206,30,216,107,30],"24134842",[259,206,30,216,260,30],"24135539","greggman3",[262,206,30,216,107,30],"24138676",[264,206,30,191,260,30],"24142614",[266,206,30,216,107,30],"24142795",[268,206,30,210,255,30],"24140463",[270,206,30,210,271,30],"24132490","DLA",[273,206,30,216,107,30],"24134531",[275,206,30,210,276,30],"24138740","luminadiffusion",[114,33,33,196,115,30],[279,33,33,196,50,30],"24130550",[122,281,33,196,123,30],4,[283,281,33,284,285,30],"24131461","project\u002Fneutral\u002Fidea","tyingq",[153,281,33,196,154,30],[65,288,33,237,66,30],5,[290,291,33,292,188,30],"24130240",6,"project\u002Fneutral\u002Fpricing",[57,291,30,292,11,32],[126,164,33,196,127,30],[296,164,33,196,50,30],"24130568",[69,164,33,284,70,30],[299,164,30,300,11,32],"24133525","project\u002Fneutral\u002Fexecution",[141,302,33,196,142,30],8,[81,302,30,284,11,32],[133,302,33,196,134,30],[306,302,30,196,11,32],"24131612",[308,302,33,237,309,30],"24132821","abeppu",[88,302,30,237,11,32],[],[313,317,321,326,331,335],{"id":314,"name":315,"points":316,"category":20},"24079592","Hndex.org",442,{"id":318,"name":319,"points":320,"category":20},"24120325","EventNative",228,{"id":322,"name":323,"points":324,"category":325},"24132631","Kinopio.club",181,"productivity",{"id":327,"name":328,"points":329,"category":330},"24099037","Kowl",164,"infrastructure",{"id":332,"name":333,"points":334,"category":20},"24131723","dstack",134,{"id":336,"name":337,"points":338,"category":339},"24129714","NeuralCam Live",117,"ai",false,"v2",{"id":343,"name":5,"line":6,"ai":340,"cat":20,"year":13,"points":14,"comments":15,"rec":27,"s":28,"top":18,"kw":344,"maker":11,"domain":10,"tier":19,"attempts":30,"strip":345,"url":9,"mix":346,"praise":78,"objection":92,"sub":21},24119113,[21,24,25,26],"3000000100000001301000000003333303303303",[30,31,32,33],1794036594613]