[{"data":1,"prerenderedAt":235},["ShallowReactive",2],{"project-13211132":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":28,"sentiment":29,"stance_mix":30,"scored_comments":18,"aspects":35,"strip":40,"post_text":41,"what":42,"said":71,"maker_in_thread":151,"shape":158,"grid":162,"attempts":195,"same_week":196,"maker_shows":34,"maker_hidden":227,"reader_version":228,"card":229},"13211132","HoverPy","Subreddit classifier using scikit-learn and a high-performance Go proxy","title","Show HN: Subreddit classifier using scikit-learn and a high-performance Go proxy","http:\u002F\u002Fioloop.io\u002Fblog\u002Fhoverpy-scikitlearn\u002F","ioloop.io","ioloop",1482153118,2016,170,17,182,2264,9,"notable","ai","text classification","other",[24,21,25,26,27],"scikit-learn","subreddit classifier","http caching proxy","golang","curious",0.127,{"positive":31,"neutral":32,"mixed":33,"critical":34},3,5,0,1,{"idea":36,"docs":38,"execution":39},{"positive":37,"critical":33},2,{"positive":34,"critical":34},{"positive":33,"critical":33},[32,33,31,33,33,32,34,33,31,33,31,31,32,33,31,33,33],null,{"problem":41,"audience":41,"pricing":41,"motivation":43,"time_to_build":41,"stack":53,"openness":69,"stage":70,"team_size":70},{"value":44,"source":45,"evidence":46},"Maker is playing with scikit-learn and found the Go caching proxy useful for varied tasks.","maker",[47,50],{"id":48,"by":11,"text":49},"13211929","You are indeed right, and I encourage anyone interested in computing the precision metrics to do so. The focus of this post is the GoLang proxy used for the caching. It's…",{"id":51,"by":11,"text":52},"13212475","Indeed. I've been very busy with work, but I'll dedicate a lot more time to articles like this, and shall list them all on the frontpage of http:\u002F\u002Fioloop.io. So if you just…",[54,60,64],{"value":55,"source":45,"evidence":56},"Go",[57,59],{"id":58},"post",{"id":48,"by":11,"text":49},{"value":24,"source":45,"evidence":61},[62,63],{"id":58},{"id":48,"by":11,"text":49},{"value":65,"source":66,"evidence":67},"Python","inferred",[68],{"id":48,"by":11,"text":49},"open_source","unknown",{"praise":72,"objections":89,"requests":103,"questions":124,"alternatives":139},[73],{"value":74,"source":75,"evidence":76},"Clear, useful write-up and resource for learning text classification","commenter",[77,81,85],{"id":78,"by":79,"text":80},"13211735","garysieling","This is really cool. I've been working on a search engine for lectures, and I recently set it up so you can filter conference talks by the programming language.…",{"id":82,"by":83,"text":84},"13211928","Spooky23","This is a really great resource. Thank you. I'm just getting started with experimenting in this topic, and it's great to see something that isn't about classifying flower petals…",{"id":86,"by":87,"text":88},"13211904","derekja","Agree, nice article! Afraid other than your posts making it to front page, I don't see how to keep checking: -- can't find an RSS feed for your blog -- ioloop.io has a blank…",[90,97],{"value":91,"source":75,"evidence":92},"No classifier accuracy or precision results reported, only 15 test cases",[93],{"id":94,"by":95,"text":96},"13211867","jackschultz","Wait, you had 15 test cases, and didn't even say how the classifier did? I guess I could run the code myself, and that's nice you provided it on Github, but still, I feel like…",{"value":98,"source":75,"evidence":99},"Training data quality limits results; more data needed",[100],{"id":101,"by":95,"text":102},"13211965","Well sure it's possible, I've done writeups on text classification with Scikit-Learn as well here:…",[104,109,117],{"value":105,"source":75,"evidence":106},"Report precision metrics in a follow-up post",[107,108],{"id":94,"by":95,"text":96},{"id":101,"by":95,"text":102},{"value":110,"source":75,"evidence":111},"Add RSS feed or a clear place to follow future posts",[112,113],{"id":86,"by":87,"text":88},{"id":114,"by":115,"text":116},"13211980","mcncfie","+1",{"value":118,"source":75,"evidence":119},"Explain why MultinomialNB was chosen",[120],{"id":121,"by":122,"text":123},"13212620","sandwell","This is a great post, and overlaps somewhat with a project I'm working on (scraping and classifying large amounts of text). I know it's not the focus of the post, but was there…",[125,135],{"value":126,"source":75,"evidence":127},"What is the use case for the caching proxy?",[128,132],{"id":129,"by":130,"text":131},"13213753","maksimum","I'm still confused about the use case. Is the purpose of a cache like this to create a unified interface to accessing and storing web pages? So you can write code to scrape pages…",{"id":133,"by":79,"text":134},"13214001","It's possible that the proxy caches duplicate requests, e.g. if you're crawling articles linked on reddit.",{"value":136,"source":75,"evidence":137},"How does the proxy compare with scrapy httpcache middleware?",[138],{"id":121,"by":122,"text":123},[140,147],{"value":141,"source":75,"evidence":142},"H2O.ai, which exports classifiers as Java code",[143],{"id":144,"by":145,"text":146},"13216934","zero-x","Looks very interesting, have you looked at H2O.ai which spits out a classifiers as Java code which can be wrapped in an ultra low latency API without caching.",{"value":148,"source":75,"evidence":149},"Scrapy with httpcache middleware",[150],{"id":121,"by":122,"text":123},{"comments":32,"answered":31,"key":152},[153,156,157],{"id":154,"text":155},"13211853","Thank you. Post author here. I'm glad you enjoyed it. I'll write many more blog posts over the christmas period on the same topic, so if you enjoyed then do keep checking.",{"id":51,"text":52},{"id":48,"text":49},{"commenters":18,"max_depth":159,"maker_replies":32,"first_comment_mins":160,"lifespan_hours":161},4,104,13,[163,165,167,169,171,172,174,176,178,180,183,185,186,188,190,191,193],[78,33,32,164,79,33],"project\u002Fpositive\u002Fidea",[154,33,33,166,11,34],"maker\u002Fpositive\u002Fnone",[86,33,31,168,87,33],"maker\u002Fneutral\u002Fdocs",[114,33,33,170,115,33],"commenter\u002Fneutral\u002Fnone",[51,33,33,168,11,34],[173,33,32,164,79,33],"13211989",[94,34,34,175,95,33],"project\u002Fcritical\u002Fdocs",[48,34,33,177,11,34],"project\u002Fneutral\u002Fdocs",[101,34,31,179,95,33],"project\u002Fneutral\u002Fexecution",[181,34,33,182,11,34],"13212020","maker\u002Fpositive\u002Fdocs",[129,37,31,184,130,33],"project\u002Fneutral\u002Fidea",[133,37,31,184,79,33],[82,31,32,187,83,33],"project\u002Fpositive\u002Fdocs",[189,31,33,166,11,34],"13212421",[121,159,31,179,122,33],[144,32,33,192,145,33],"other\u002Fneutral\u002Fnone",[194,32,33,192,79,33],"13216974",[],[197,202,207,212,217,222],{"id":198,"name":199,"points":200,"category":201},"13194074","Oldster",475,"web_saas",{"id":203,"name":204,"points":205,"category":206},"13184143","Godb",205,"languages",{"id":208,"name":209,"points":210,"category":211},"13202610","Spark School",190,"learning_science",{"id":213,"name":214,"points":215,"category":216},"13230954","Google Blade",88,"productivity",{"id":218,"name":219,"points":220,"category":221},"13208352","Libtmux",86,"dev_tools",{"id":223,"name":224,"points":225,"category":226},"13188522","GoboLinux 016 featuring Runner",80,"infrastructure",false,"v2",{"id":230,"name":5,"line":6,"ai":227,"cat":20,"year":13,"points":14,"comments":15,"rec":28,"s":231,"top":18,"kw":232,"maker":11,"domain":10,"tier":19,"attempts":33,"strip":233,"url":9,"mix":234,"praise":74,"objection":91,"sub":21},13211132,0.13,[24,21,25,26,27],"50300510303350300",[31,32,33,34],1793990952005]