[{"data":1,"prerenderedAt":397},["ShallowReactive",2],{"project-20334779":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":28,"sentiment":29,"stance_mix":30,"scored_comments":35,"aspects":36,"strip":43,"post_text":45,"what":46,"said":78,"maker_in_thread":176,"shape":178,"grid":183,"attempts":360,"same_week":361,"maker_shows":38,"maker_hidden":389,"reader_version":390,"card":391},"20334779","Vector","A High-Performance Log and Metric Router Written in Rust","title","Show HN: Vector – A High-Performance Log and Metric Router Written in Rust","https:\u002F\u002Fgithub.com\u002Ftimberio\u002Fvector","github.com","zhs",1562074428,2019,322,63,89,2195,5,"legend","infrastructure","log and metric routing","cli",[24,25,26,27],"log router","log shipper","metrics pipeline","rust observability","curious",0.123,{"positive":31,"neutral":32,"mixed":33,"critical":34},12,27,1,11,51,{"idea":37,"execution":39,"docs":41,"performance":42},{"positive":38,"critical":38},3,{"positive":40,"critical":40},2,{"positive":33,"critical":40},{"positive":33,"critical":38},[18,33,38,38,33,38,18,44,38,18,38,38,33,44,18,38,38,38,38,38,18,38,38,38,18,38,38,18,18,33,33,33,33,18,18,38,33,38,33,44],0,null,{"problem":47,"audience":45,"pricing":45,"motivation":59,"time_to_build":45,"stack":68,"openness":75,"stage":76,"team_size":77},{"value":48,"source":49,"evidence":50},"Collecting, transforming and routing logs and metrics from applications and infrastructure to storage backends","commenter",[51,55],{"id":52,"by":53,"text":54},"20335781","reacharavindh","I was dragging my feet to build a log shipper solution. I was going to use Filebeat -> ElasticSearch -> Kibana. This looks great. My primary attraction is possibly low memory…",{"id":56,"by":57,"text":58},"20339894","lukes386","I've looked into OpenCensus\u002FOpenTracing\u002FOpenTelemetry (and the apparently unaffiliated OpenMetrics?) a bit, but I'm not as familiar as I'd like to be. It does seem like they're…",{"value":60,"source":49,"evidence":61},"Make log and metric routing and transformation available in one tool without separate tools",[62,65],{"id":63,"by":57,"text":64},"20335966","We really love the idea of mtail and think it's criminally underused. A big part of the reason we started building Vector was to integrate that kind of functionality into a…",{"id":66,"by":57,"text":67},"20335606","Hi! I work on Vector. For a motivating example, let's say you have an application fronted by nginx. Using Vector would allow you to ingest your nginx logs off disk, parse them,…",[69],{"value":70,"source":71,"evidence":72},"Rust","maker",[73],{"id":74},"post","open_source","beta","company",{"praise":79,"objections":93,"requests":110,"questions":128,"alternatives":143},[80,88],{"value":81,"source":49,"evidence":82},"Low memory footprint and Rust performance",[83,84],{"id":52,"by":53,"text":54},{"id":85,"by":86,"text":87},"20335658","dandigangi","Freaking A... Rust performance is nuts when done right. Very cool.",{"value":89,"source":49,"evidence":90},"Easy transformations and one-tool approach",[91,92],{"id":52,"by":53,"text":54},{"id":66,"by":57,"text":67},[94,101],{"value":95,"source":49,"evidence":96},"Fewer inputs and outputs than established tools",[97],{"id":98,"by":99,"text":100},"20335740","the_duke","There already are a lot of projects in this space. While better performance is always great, most are already plenty fast for the majority of use cases. The main power comes from…",{"value":102,"source":49,"evidence":103},"Benchmarks against Logstash appear unfair due to default memory config",[104,107],{"id":105,"by":99,"text":106},"20336093","They are using the default config with 1GB memory. Sadly that's absolutely nothing for Logstash. Reported an issue in their test harness.",{"id":108,"by":99,"text":109},"20336378","It's perfectly valid to mention the higher memory requirements as a considerable drawback. But this is far from the possible performance that Logstash offers, so the comparison…",[111,122],{"value":112,"source":49,"evidence":113},"Add Clickhouse sink",[114,118],{"id":115,"by":116,"text":117},"20336993","jhgg","We use a rather bespoke syslog -> clickhouse log sink (https:\u002F\u002Fgithub.com\u002Fdiscordapp\u002Fpunt\u002Ftree\u002Fclickhouse) we wrote in house because logstash (and then subsequently elastic…",{"id":119,"by":120,"text":121},"20337563","binarylogic","Absolutely, this is likely the next integration we'll be working on. There were a few features schema-wise that we needed support before we started, but we're _very_ close. We'd…",{"value":123,"source":49,"evidence":124},"Add metrics sources and sinks such as Graphite and Datadog",[125],{"id":126,"by":57,"text":127},"20335902","Thank you! Very glad it looks useful to you. It's still slightly rough around the edges, but Vector can actually ingest metrics today in addition to deriving metrics from log…",[129,136],{"value":130,"source":49,"evidence":131},"How does it compare to Telegraf",[132],{"id":133,"by":134,"text":135},"20336528","dm03514","How does this compare to telegraf? https:\u002F\u002Fgithub.com\u002Finfluxdata\u002Ftelegraf Biggest thing that pops out to me is LUA engine (seems amazing :) )",{"value":137,"source":49,"evidence":138},"Does it handle back pressure",[139],{"id":140,"by":141,"text":142},"20342698","rishiloyola","How do you handle back pressure? Do you have specific module for it?",[144,152,156,163,170],{"value":145,"source":49,"evidence":146},"Filebeat",[147,148],{"id":52,"by":53,"text":54},{"id":149,"by":150,"text":151},"20336561","Thaxll","You better use something reliable and tested like Filebeat, it's written in Go and is fast enough \u002F low memory usage.",{"value":153,"source":49,"evidence":154},"Telegraf",[155],{"id":133,"by":134,"text":135},{"value":157,"source":49,"evidence":158},"Veneur",[159],{"id":160,"by":161,"text":162},"20337184","kalkin","Seems similar to Veneur (like many other projects mentioned in comments here; didn't realize this space was so crowded!) - down to the first two letters of the name:…",{"value":164,"source":49,"evidence":165},"mtail",[166],{"id":167,"by":168,"text":169},"20335897","navaati","What you're asking for kinda exist, it's called mtail, check it out !",{"value":171,"source":49,"evidence":172},"Logstash",[173],{"id":174,"by":141,"text":175},"20336011","Well logstash is now supporting good persistent queue. https:\u002F\u002Fwww.elastic.co\u002Fguide\u002Fen\u002Flogstash\u002Fcurrent\u002Fpersistent-queues.html#durability-persistent-queues I don't know why…",{"comments":44,"answered":44,"key":177},[],{"commenters":179,"max_depth":180,"maker_replies":44,"first_comment_mins":181,"lifespan_hours":182},39,6,43,40,[184,186,188,190,192,196,198,200,201,203,205,208,210,212,214,218,222,227,230,231,234,237,240,243,245,247,251,253,258,261,264,266,268,271,274,277,278,281,283,286,289,293,295,298,301,305,307,311,313,317,318,320,322,326,330,334,338,340,344,346,351,355,358],[52,44,18,185,53,44],"project\u002Fpositive\u002Fidea",[167,44,33,187,168,44],"project\u002Fcritical\u002Fidea",[63,44,38,189,57,44],"maker\u002Fneutral\u002Fidea",[126,44,38,191,57,44],"project\u002Fneutral\u002Fexecution",[193,44,44,194,195,44],"20339290","other\u002Fneutral\u002Fnone","wikibob",[56,44,38,197,57,44],"project\u002Fneutral\u002Fidea",[149,44,33,199,150,44],"project\u002Fcritical\u002Fexecution",[160,33,38,197,161,44],[202,33,38,197,57,44],"20338078",[115,40,18,204,116,44],"project\u002Fpositive\u002Fexecution",[206,40,44,207,53,44],"20337443","commenter\u002Fneutral\u002Fnone",[209,40,44,194,116,44],"20340274",[211,40,44,194,53,44],"20342070",[119,40,38,213,120,44],"project\u002Fneutral\u002Fnone",[215,40,18,216,217,44],"20343762","maker\u002Fpositive\u002Fnone","codepodu",[219,38,33,220,221,44],"20338258","project\u002Fcritical\u002Fdocs","SwellJoe",[223,224,18,225,226,44],"20335414",4,"project\u002Fpositive\u002Fdocs","kevsim",[228,18,38,191,229,44],"20344499","nickserv",[174,180,33,220,141,44],[232,180,38,233,120,44],"20336065","project\u002Fneutral\u002Fperformance",[235,180,44,194,236,44],"20336101","butteroverflow",[238,180,44,194,239,44],"20338299","itamarhaber",[85,241,18,242,86,44],7,"project\u002Fpositive\u002Fperformance",[133,244,38,197,134,44],8,[246,244,38,197,120,44],"20336816",[248,249,38,191,250,44],"20341675",9,"envolt",[252,249,38,191,120,44],"20344886",[254,255,38,256,257,44],"20340702",10,"project\u002Fneutral\u002Fdocs","nh2",[259,255,38,256,260,44],"20340807","amanzi",[262,255,44,263,257,44],"20343381","commenter\u002Fneutral\u002Fdocs",[265,255,38,256,257,44],"20343412",[267,255,38,256,120,44],"20347828",[269,34,18,216,270,44],"20337946","zackkitzmiller",[272,31,38,197,273,44],"20335352","asprouse",[275,31,38,256,276,44],"20335427","timerol",[66,31,38,197,57,44],[279,31,38,197,280,44],"20336135","geodel",[282,31,38,197,57,44],"20337060",[284,31,18,285,280,44],"20337341","project\u002Fpositive\u002Fnone",[287,31,38,288,57,44],"20339637","maker\u002Fneutral\u002Fnone",[290,291,38,197,292,44],"20335559",13,"scurvy",[294,291,38,197,57,44],"20335635",[296,291,18,204,297,44],"20335894","tveita",[299,291,44,194,300,44],"20338298","sciurus",[302,303,18,185,304,44],"20335579",14,"Dowwie",[98,306,33,187,99,44],15,[308,306,38,309,310,44],"20335952","project\u002Fmixed\u002Fperformance","leetbulb",[105,306,33,312,99,44],"project\u002Fcritical\u002Fperformance",[314,306,44,315,316,44],"20336187","commenter\u002Fneutral\u002Fperformance","otterley",[108,306,33,312,99,44],[319,306,33,312,310,44],"20337292",[321,306,18,185,316,44],"20336161",[323,324,18,216,325,44],"20339907",16,"peter_l_downs",[327,328,38,233,329,44],"20350089",17,"gnufx",[331,332,18,216,333,44],"20336586",18,"heliostatic",[335,336,38,197,337,44],"20335922",19,"seruman",[339,336,33,187,99,44],"20336080",[341,342,33,199,343,44],"20351831",20,"warpspin",[140,345,38,191,141,44],21,[347,348,33,349,350,44],"20340254",22,"maker\u002Fcritical\u002Fnone","eeZah7Ux",[352,353,44,207,354,44],"20335460",23,"li4ick",[356,353,44,207,357,44],"20335573","thenewwazoo",[359,353,44,207,350,44],"20340218",[],[362,367,372,375,380,384],{"id":363,"name":364,"points":365,"category":366},"20317840","URL Pages",377,"dev_tools",{"id":368,"name":369,"points":370,"category":371},"20292104","Nearby-Shops-End-User-Android-app",227,"web_saas",{"id":373,"name":374,"points":370,"category":371},"20292638","comntr",{"id":376,"name":377,"points":378,"category":379},"20326931","Hydra",190,"security_privacy",{"id":381,"name":382,"points":383,"category":366},"20339766","A tiny JS library for real-time localization of eye pupils",153,{"id":385,"name":386,"points":387,"category":388},"20314255","DICOM",142,"languages",false,"v2",{"id":392,"name":5,"line":6,"ai":389,"cat":20,"year":13,"points":14,"comments":15,"rec":28,"s":393,"top":18,"kw":394,"maker":11,"domain":10,"tier":19,"attempts":44,"strip":395,"url":9,"mix":396,"praise":81,"objection":95,"sub":21},20334779,0.12,[24,25,26,27],"5133135035331053333353335335511115531310",[31,32,33,34],1794036578828]