[{"data":1,"prerenderedAt":272},["ShallowReactive",2],{"project-18987102":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":35,"aspects":36,"strip":39,"post_text":42,"what":43,"said":90,"maker_in_thread":167,"shape":175,"grid":179,"attempts":231,"same_week":232,"maker_shows":263,"maker_hidden":264,"reader_version":265,"card":266},"18987102","CloudQuery","Turn any website to serverless API with SPA support","title","Show HN: CloudQuery – Turn any website to serverless API with SPA support","https:\u002F\u002Fgithub.com\u002Fcloudfetch\u002Fcloudquery","github.com","timqian",1548320820,2019,117,23,399,2195,19,"notable","dev_tools","web scraping api generator","api",[24,25,26,27,28],"web scraping","serverless api","headless chrome","rss feed","scraper","loved",0.227,{"positive":32,"neutral":33,"mixed":34,"critical":34},4,7,0,11,{"idea":37,"pricing":38},{"positive":32,"critical":34},{"positive":34,"critical":34},[34,34,34,34,40,34,34,40,34,34,34,40,34,40,40,41,40,34,41,40,41,34,41],3,5,null,{"problem":44,"audience":56,"pricing":64,"motivation":71,"time_to_build":42,"stack":75,"openness":87,"stage":88,"team_size":89},{"value":45,"source":46,"evidence":47},"Websites without APIs or RSS feeds cannot easily supply structured data to other tools","commenter",[48,52],{"id":49,"by":50,"text":51},"18988612","tobyhinloopen","My guess: Rapid prototyping of tools that use scraping as a source of data. We actually have multiple tools that do realtime scraping as the primary data source. Many of these…",{"id":53,"by":54,"text":55},"19006226","karlhughes","I use a very similar tool (https:\u002F\u002Fwrapapi.com\u002F) to generate JSON feeds for From Founders (https:\u002F\u002Fwww.fromfounders.com\u002F). I noticed that lots of these founder interview sites…",{"value":57,"source":58,"evidence":59},"Developers who need data from sites lacking APIs","inferred",[60,61],{"id":49,"by":50,"text":51},{"id":62,"by":11,"text":63},"18988889","This tool generates APIs providing data, developers can make use of the API to build other tools. For example I build https:\u002F\u002Fcloudfetch.info based on it. More strictly speaking,…",{"value":65,"source":66,"evidence":67},"AWS Lambda costs; the maker says invocations are cheap","maker",[68],{"id":69,"by":11,"text":70},"18994485","For pages require login, it is not implemented yet as this is a little complicated , but it is not impossible, the tool need to record actions user do and replay it in the remote…",{"value":72,"source":66,"evidence":73},"Maker extracted it from their own cloudfetch project because an API could have more use cases",[74],{"id":62,"by":11,"text":63},[76,83],{"value":77,"source":46,"evidence":78},"Serverless Chrome",[79],{"id":80,"by":81,"text":82},"18990430","mrspeaker","Very neat idea! I like do this locally in Emacs (by scraping `M-x eww` output!), but having an API is a great idea! How would you go about using it on sites that require login…",{"value":84,"source":46,"evidence":85},"AWS Lambda",[86],{"id":80,"by":81,"text":82},"open_source","launched","unknown",{"praise":91,"objections":107,"requests":115,"questions":127,"alternatives":139},[92],{"value":93,"source":46,"evidence":94},"Useful idea, similar to Kimono and Yahoo Pipes",[95,99,103],{"id":96,"by":97,"text":98},"18989848","leowoo91","Looks great, reminds me of Kimono labs.",{"id":100,"by":101,"text":102},"18992422","LikeAnElephant","LOVED Kimonify, especially how it (somehow!) figured out the pattern of data after clicking on a few different items. This is very close to that, minus the pattern recognition.",{"id":104,"by":105,"text":106},"18988526","hiccuphippo","I was able to do this 10 years ago with Yahoo!Pipes :(",[108],{"value":109,"source":46,"evidence":110},"Copyright concerns such as EU Article 13 could affect scraping-based feeds",[111],{"id":112,"by":113,"text":114},"18987750","Jaruzel","Nice. I've been toying with the same idea, but with optional RSS formatting to be able to generate an RSS feed from any website. What's stopping me though is the EUs Article 13,…",[116,120],{"value":117,"source":46,"evidence":118},"Support for pages behind login",[119],{"id":80,"by":81,"text":82},{"value":121,"source":46,"evidence":122},"Graphical element selection for extraction",[123],{"id":124,"by":125,"text":126},"18990553","onli","You can do this now with https:\u002F\u002Fwww.pipes.digital\u002F :) And I'm actually working on making the extract block more powerful, having a graphical way to select elements.",[128,135],{"value":129,"source":46,"evidence":130},"What is the use case?",[131],{"id":132,"by":133,"text":134},"18988548","lugrugzo","What's the use case of this tool?",{"value":136,"source":46,"evidence":137},"Is running headless Chrome on Lambda expensive?",[138],{"id":80,"by":81,"text":82},[140,148,152,159,163],{"value":141,"source":46,"evidence":142},"Yahoo Pipes",[143,144],{"id":104,"by":105,"text":106},{"id":145,"by":146,"text":147},"18988757","dmitriid","Where's Yahoo! Pipes when you need them...",{"value":149,"source":46,"evidence":150},"Kimono Labs",[151],{"id":96,"by":97,"text":98},{"value":153,"source":46,"evidence":154},"Feedity",[155],{"id":156,"by":157,"text":158},"18993839","nreece","This looks good! * Shameless plug *: Our little startup, Feedity - https:\u002F\u002Ffeedity.com, helps create XML\u002FRSS feeds for any public webpage, even JS\u002FXHR\u002FSPAs and social networks…",{"value":160,"source":46,"evidence":161},"wrapapi",[162],{"id":53,"by":54,"text":55},{"value":164,"source":46,"evidence":165},"Pipes Digital",[166],{"id":124,"by":125,"text":126},{"comments":40,"answered":168,"key":169},2,[170,173,174],{"id":171,"text":172},"18989266","Yahoo also have a similar tool nowadays called YQL, I tried it but faild to make a query..",{"id":69,"text":70},{"id":62,"text":63},{"commenters":176,"max_depth":32,"maker_replies":40,"first_comment_mins":177,"lifespan_hours":178},21,140,72,[180,182,186,189,192,194,196,199,200,201,202,205,207,209,213,216,218,221,225,226,228,229,230],[112,34,34,181,113,34],"commenter\u002Fneutral\u002Fidea",[183,34,34,184,185,34],"18987857","other\u002Fneutral\u002Fnone","tmikaeld",[187,34,34,184,188,34],"19011048","GrzegorzWidla",[190,34,34,184,191,34],"18988128","IanCal",[104,34,40,193,105,34],"project\u002Fneutral\u002Fidea",[171,34,34,184,11,195],1,[197,34,34,184,198,34],"18990286","franze",[124,34,40,193,125,34],[156,195,34,184,157,34],[145,168,34,184,146,34],[203,168,34,184,204,34],"18989946","morenoh149",[80,40,40,206,81,34],"project\u002Fneutral\u002Fpricing",[69,40,34,208,11,195],"maker\u002Fneutral\u002Fpricing",[210,40,40,211,212,34],"18995384","maker\u002Fneutral\u002Fnone","fefb",[214,32,40,193,215,34],"18991804","orliesaurus",[100,32,41,217,101,34],"project\u002Fpositive\u002Fidea",[219,41,40,193,220,34],"18989860","aboutruby",[222,223,34,184,224,34],"19006551",6,"bobbydreamer",[96,33,41,217,97,34],[132,227,40,193,133,34],8,[49,227,41,217,50,34],[62,227,34,193,11,195],[53,227,41,217,54,34],[],[233,238,243,248,253,258],{"id":234,"name":235,"points":236,"category":237},"19025560","Open Startups (postmake.io\u002Fopen)",475,"data",{"id":239,"name":240,"points":241,"category":242},"19017270","X-spreadsheet",347,"languages",{"id":244,"name":245,"points":246,"category":247},"19025709","AiFiddle",216,"ai",{"id":249,"name":250,"points":251,"category":252},"19023196","Apprise",163,"infrastructure",{"id":254,"name":255,"points":256,"category":257},"18997160","MadCO2",146,"hardware",{"id":259,"name":260,"points":261,"category":262},"19013445","Notepin",144,"productivity",10,false,"v2",{"id":267,"name":5,"line":6,"ai":264,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":268,"top":18,"kw":269,"maker":11,"domain":10,"tier":19,"attempts":34,"strip":270,"url":9,"mix":271,"praise":93,"objection":109,"sub":21},18987102,0.23,[24,25,26,27,28],"00003003000303353053505",[32,33,34,34],1794036574268]