[{"data":1,"prerenderedAt":181},["ShallowReactive",2],{"project-9340299":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":34,"aspects":35,"strip":38,"post_text":40,"what":41,"said":65,"maker_in_thread":112,"shape":120,"grid":123,"attempts":143,"same_week":144,"maker_shows":173,"maker_hidden":174,"reader_version":175,"card":176},"9340299","Redis-pipe","Use Redis lists like Unix pipes","title","Show HN: Redis-pipe – Use Redis lists like Unix pipes","https:\u002F\u002Fgithub.com\u002Flukasmartinelli\u002Fredis-pipe","github.com","morgenkaffee",1428496552,2015,49,10,574,2565,23,"shown","dev_tools","command line pipe utility","cli",[24,25,26,27,28],"redis","unix pipes","job queue","command line","redis lists","mixed",0,{"positive":32,"neutral":32,"mixed":30,"critical":33},2,1,5,{"idea":36,"design":37},{"positive":33,"critical":30},{"positive":33,"critical":33},[34,30,34,33,30,39,39,30,30,30],3,null,{"problem":42,"audience":40,"pricing":40,"motivation":40,"time_to_build":40,"stack":51,"openness":64,"stage":64,"team_size":64},{"value":43,"source":44,"evidence":45},"Passing data between processes or machines through Redis lists like a Unix pipe","maker",[46,48],{"id":47},"post",{"id":49,"by":11,"text":50},"9340527","I use it as a poor man's job queue. cat jobs.txt | redis-pipe jobs An then on several workers: redis-pipe --count 10 jobs | python do-work.py | redis-pipe results An then in the…",[52,60],{"value":53,"source":54,"evidence":55},"Go","commenter",[56],{"id":57,"by":58,"text":59},"9341085","fprotthetarball","The interesting thing about rp is that you can use it as a pipeline in your other Go applications, as the Redis pub\u002Fsub \"pipe\" is exposed as a normal Go io.Reader\u002Fio.Writer…",{"value":61,"source":44,"evidence":62},"Redis",[63],{"id":47},"unknown",{"praise":66,"objections":75,"requests":83,"questions":90,"alternatives":98},[67],{"value":68,"source":54,"evidence":69},"Useful as a simple job queue or logging pipe",[70,71],{"id":49,"by":11,"text":50},{"id":72,"by":73,"text":74},"9340502","bytesandbots","I guess it might be very useful in a cloud like environment where you use this set up to pipe data across scaled up servers.",[76],{"value":77,"source":54,"evidence":78},"Uses LPUSH\u002FLPOP so only one consumer gets each message, not pub\u002Fsub",[79],{"id":80,"by":81,"text":82},"9340755","nissimk","Why are you using LPUSH\u002FLPOP instead of PUBLISH\u002FPSUBSCRIBE? I guess you get storage that way, but only one consumer of each message. It would be nice if it was optional in case…",[84],{"value":85,"source":44,"evidence":86},"Add --publish and --subscribe flags for multiple subscribers",[87],{"id":88,"by":11,"text":89},"9340783","Yes you're right. I can create a flag --publish and --subscribe.",[91],{"value":92,"source":54,"evidence":93},"Why use Redis instead of Unix pipes?",[94],{"id":95,"by":96,"text":97},"9340435","waitingkuo","What's the benefit to use Redis pipe instead of Unix pipes?",[99,105],{"value":100,"source":54,"evidence":101},"rp, a Redis pub\u002Fsub pipe tool",[102],{"id":103,"by":58,"text":104},"9340945","See this for more inspiration (using pub\u002Fsub): https:\u002F\u002Fgithub.com\u002Fwhee\u002Frp",{"value":106,"source":54,"evidence":107},"Celery with Redis backend",[108],{"id":109,"by":110,"text":111},"9340703","eddd","Poor man's job queue is celery with redis backend i guess.",{"comments":113,"answered":33,"key":114},4,[115,118,119],{"id":116,"text":117},"9341022","Ah that's the same idea! Wished I found that before. Thanks man.",{"id":88,"text":89},{"id":49,"text":50},{"commenters":121,"max_depth":34,"maker_replies":113,"first_comment_mins":122,"lifespan_hours":32},6,29,[124,126,128,130,132,134,136,137,138,140],[103,30,34,125,58,30],"project\u002Fpositive\u002Fidea",[116,30,30,127,11,33],"maker\u002Fneutral\u002Fidea",[57,30,34,129,58,30],"project\u002Fpositive\u002Fdesign",[80,33,33,131,81,30],"project\u002Fcritical\u002Fdesign",[88,33,30,133,11,33],"maker\u002Fpositive\u002Fdesign",[95,32,39,135,96,30],"project\u002Fneutral\u002Fidea",[72,32,39,135,73,30],[49,32,30,125,11,33],[109,32,30,139,110,30],"other\u002Fneutral\u002Fnone",[141,32,30,142,11,33],"9340773","project\u002Fneutral\u002Fnone",[],[145,150,154,158,163,168],{"id":146,"name":147,"points":148,"category":149},"9340246","Kaiwa",339,"productivity",{"id":151,"name":152,"points":153,"category":20},"9332718","Frontend HQ Pinger",199,{"id":155,"name":156,"points":157,"category":20},"9309877","AtomPair",127,{"id":159,"name":160,"points":161,"category":162},"9328006","Crudlet.js",94,"languages",{"id":164,"name":165,"points":166,"category":167},"9316722","autocompeter",76,"infrastructure",{"id":169,"name":170,"points":171,"category":172},"9329048","Quant News",73,"finance_crypto",7,false,"v2",{"id":177,"name":5,"line":6,"ai":174,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":30,"top":18,"kw":178,"maker":11,"domain":10,"tier":19,"attempts":30,"strip":179,"url":9,"mix":180,"praise":68,"objection":77,"sub":21},9340299,[24,25,26,27,28],"5051033000",[32,32,30,33],1793990922735]