[{"data":1,"prerenderedAt":610},["ShallowReactive",2],{"project-30539620":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":9,"maker":10,"posted_at":11,"year":12,"points":13,"comments":14,"rank_in_year":15,"shown_in_year":16,"top":17,"tier":18,"category":19,"subcategory":20,"format":21,"keywords":22,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":34,"aspects":35,"strip":48,"post_text":49,"what":50,"said":96,"maker_in_thread":230,"shape":243,"grid":248,"attempts":570,"same_week":571,"maker_shows":40,"maker_hidden":601,"reader_version":602,"card":603},"30539620","DontBeEvil.rip","Search, for developers (API, expressions, CLI)","title","Show HN: DontBeEvil.rip: Search, for developers (API, expressions, CLI)",null,"alangibson",1646306702,2022,269,121,167,2570,7,"legend","web_saas","developer search engine","api",[23,24,25,26],"developer search","search api","elasticsearch","programming search engine","curious",0.014,{"positive":30,"neutral":31,"mixed":32,"critical":33},12,36,3,11,62,{"execution":36,"privacy":38,"idea":41,"pricing":43,"docs":44,"design":45,"performance":47},{"positive":32,"critical":37},5,{"positive":39,"critical":40},0,1,{"positive":42,"critical":40},4,{"positive":39,"critical":40},{"positive":39,"critical":40},{"positive":32,"critical":46},2,{"positive":39,"critical":39},[32,39,39,39,40,37,40,32,32,37,42,32,32,32,32,32,37,40,40,37,37,42,32,32,40,32,46,40,40,32,32,37,40,37,32,32,40,32,37,32],"I'd like to invite everyone to try out DontBeEvil.rip, an experimental search engine for developers.\n\ntl;dr\n\n$ alias rip=\"curl -G -H 'Accept: text\u002Fplain' --url https:\u002F\u002Fdontbeevil.rip\u002Fsearch --data-urlencode \"\n\n$ rip 'q=Heartbleed bug'\n\nDontBeEvil.rip is a year long experiment to see if a small team can build a developer-focused search engine that is self-sustaining on $10 monthly subscriptions.\n\nIt works by only indexing high-quality resources that are relevant to developers. You won't get useless listicles because we'll never crawl them. Relevant urls are harvested from HN, StackOverflow, pro",{"problem":51,"audience":57,"pricing":61,"motivation":65,"time_to_build":9,"stack":72,"openness":93,"stage":94,"team_size":95},{"value":52,"source":53,"evidence":54},"Search results polluted by spam and listicles; developers want relevant programming resources","maker",[55],{"id":56},"post",{"value":58,"source":53,"evidence":59},"Software developers",[60],{"id":56},{"value":62,"source":53,"evidence":63},"$10 monthly subscription planned",[64],{"id":56},{"value":66,"source":53,"evidence":67},"Test whether a small team can build a sustainable, non-ad developer search engine",[68,69],{"id":56},{"id":70,"by":10,"text":71},"30543585","The purpose of this project is to see if it's possible to build a highly targeted, privacy respecting, search engine that people will pay for. I've given myself a year to build…",[73,79,85,89],{"value":74,"source":53,"evidence":75},"Elasticsearch",[76],{"id":77,"by":10,"text":78},"30539887","Indeed it is. You can you use simple query strings for the q parameter. See…",{"value":80,"source":53,"evidence":81},"Google BigQuery",[82],{"id":83,"by":10,"text":84},"30542454","I have 3 sizeable EC2 instances running an ElasticSearch cluster, plus a beefy box for data preprocessing and crawling. A big chunk actually goes to BigQuery. There are publicly…",{"value":86,"source":53,"evidence":87},"Amazon EC2",[88],{"id":83,"by":10,"text":84},{"value":90,"source":53,"evidence":91},"Common Crawl data",[92],{"id":56},"unknown","beta","team",{"praise":97,"objections":121,"requests":161,"questions":202,"alternatives":221},[98,110],{"value":99,"source":100,"evidence":101},"Idea of curated, whitelist-style developer search is appealing","commenter",[102,106],{"id":103,"by":104,"text":105},"30541963","arminiusreturns","Best of luck to you, I think there is a targettable niche that could utilize this. Having thought quite a bit about the search space, I think a whitelist approach is going to be…",{"id":107,"by":108,"text":109},"30539913","przemub","I really like it and it already gives some useful results. A rise of curated search engines as yours would be lovely. It would be nice if the main page linked to your blog or…",{"value":111,"source":100,"evidence":112},"CLI and plain-text access are useful",[113,117],{"id":114,"by":115,"text":116},"30540117","ykevinator2","Can we drop the q= and the quotes from the shell cmd somehow, that would make it so much nicer, and rip is a great command line.",{"id":118,"by":119,"text":120},"30542907","Traster","This is an interesting approach to the general problem. The general problem being that whatever data source you use is inevitably going to be polluted by players who wish to be…",[122,137,142,153],{"value":123,"source":100,"evidence":124},"Results are noisy and off-topic for many queries",[125,129,133],{"id":126,"by":127,"text":128},"30540240","sitkack","I love this idea. This is mostly just raw data, it isn't that useful (yet). The security issues with using curl directly to my terminal feel a bit dangerous. I'd rather use my…",{"id":130,"by":131,"text":132},"30540985","operator-name","I've tried it out. It's quite obvious the limited number of crawled sites when searching for anything obscure or one step outside of programming. Even 'javascript reverse…",{"id":134,"by":135,"text":136},"30547795","AnyTimeTraveler","I just tried a few queries related to rust and it's library rocket. I got only useless results on the first page and didn't check further. I'm guessing that's because it doesn't…",{"value":138,"source":100,"evidence":139},"Missing key docs sources such as MDN, docs.rs and language docs",[140,141],{"id":130,"by":131,"text":132},{"id":134,"by":135,"text":136},{"value":143,"source":100,"evidence":144},"Internal server errors on ordinary queries",[145,149],{"id":146,"by":147,"text":148},"30539994","feanaro","Getting internal server error for many ordinary requests. I'm not able to discern a pattern. An example is `rip 'q=zelda'`.",{"id":150,"by":151,"text":152},"30539993","dorianmariefr","I'm getting: > {\"message\": \"Internal server error\"}",{"value":154,"source":100,"evidence":155},"Raw Elasticsearch access and curl usage raise security concerns",[156,157],{"id":126,"by":127,"text":128},{"id":158,"by":159,"text":160},"30540868","tekromancr","What security implications does running curl have that wouldn't be present in a browser?",[162,168,183,187,198],{"value":163,"source":100,"evidence":164},"Add language and library documentation",[165,166,167],{"id":130,"by":131,"text":132},{"id":134,"by":135,"text":136},{"id":126,"by":127,"text":128},{"value":169,"source":100,"evidence":170},"Add a web front-end or homepage",[171,175,179],{"id":172,"by":173,"text":174},"30541456","martinald","Why not make a website for this? Why just limit it to the terminal (hard to use on mobile for example)? Edit: obviously you can query it from a browser, but it would take like a…",{"id":176,"by":177,"text":178},"30540007","erklik","> programmer Reddit Is it just \u002Fr\u002Fprogrammer? or many other programming related subreddits? In general though, this is great. I would similarly love a solution where we could…",{"id":180,"by":181,"text":182},"30539817","husainfazel","Going to \"https:\u002F\u002Fdontbeevil.rip\u002F\" results in a JSON error in the browser: {\"message\":\"Missing Authentication Token\"}",{"value":184,"source":100,"evidence":185},"Allow users to submit sites to index",[186],{"id":176,"by":177,"text":178},{"value":188,"source":100,"evidence":189},"Index Stack Exchange sites and GitHub",[190,194],{"id":191,"by":192,"text":193},"30540219","mynameismon","> StackOverflow Does this include the entire StackExchange network, or only StackOverflow? Because some SE sites (in particular, UnixSE and ServerFault) also produce highly…",{"id":195,"by":196,"text":197},"30542041","pcthrowaway","Are you not putting github (+issues and PRs) in the indexed set?",{"value":199,"source":100,"evidence":200},"Drop q= and quotes from the CLI",[201],{"id":114,"by":115,"text":116},[203,210,214],{"value":204,"source":100,"evidence":205},"Is the project open source?",[206],{"id":207,"by":208,"text":209},"30540718","niek_pas","This looks really cool! It would be neat to have a proper CLI with a more fully-flushed out UI, with things like shortcuts to quickly open links. Is there any way I can be kept…",{"value":211,"source":100,"evidence":212},"Is it only \u002Fr\u002Fprogrammer or other subreddits?",[213],{"id":176,"by":177,"text":178},{"value":215,"source":100,"evidence":216},"Are advanced query strings supported?",[217],{"id":218,"by":219,"text":220},"30547381","l0b0","Nice! Do any more advanced query strings work right now? Like looking for recent pages or only searching titles?",[222,226],{"value":223,"source":100,"evidence":224},"devdocs.io",[225],{"id":126,"by":127,"text":128},{"value":227,"source":100,"evidence":228},"Google with site filters",[229],{"id":134,"by":135,"text":136},{"comments":231,"answered":232,"key":233},34,13,[234,237,240],{"id":235,"text":236},"30540545","Thanks for the feedback. I'm considering making searching for language docs a special use case, maybe even with its own index. > Providing raw access to ES has a high risk to…",{"id":238,"text":239},"30542095","> I think a whitelist approach is going to be the next big search thing It almost as to be. Spammers, growth hackers, et al. are just too numerous and too good. > Im not positive…",{"id":241,"text":242},"30541477","> one step outside of programming. Indeed, it's explicitly for programming only (for now). > Even 'javascript reverse string', which I expected some docs or stack overflow pages…",{"commenters":244,"max_depth":245,"maker_replies":231,"first_comment_mins":246,"lifespan_hours":247},67,8,9,40,[249,251,253,255,259,261,263,267,270,273,276,279,282,285,289,292,294,296,300,302,303,307,309,313,316,319,322,324,328,330,333,336,339,343,346,349,351,354,356,359,362,365,368,370,372,375,377,380,384,387,390,392,394,396,399,403,406,408,410,414,416,419,421,423,426,428,431,433,435,439,441,445,446,448,451,453,457,459,461,463,466,468,470,472,475,477,479,481,483,485,489,491,495,499,503,505,507,509,511,513,515,517,521,526,528,532,536,538,541,545,548,551,552,554,556,558,559,561,564,566,568],[126,39,32,250,127,39],"project\u002Fmixed\u002Fexecution",[235,39,39,252,10,40],"maker\u002Fneutral\u002Fnone",[158,39,32,254,159,39],"project\u002Fneutral\u002Fprivacy",[256,39,39,257,258,39],"30540994","commenter\u002Fneutral\u002Fprivacy","artursapek",[260,39,39,257,147,39],"30541049",[262,39,39,257,159,39],"30541722",[264,39,39,265,266,39],"30542177","commenter\u002Fneutral\u002Fnone","dundarious",[268,39,39,265,269,39],"30545751","laumars",[271,39,39,257,272,39],"30540978","fao_",[274,39,39,257,275,39],"30543611","nano9",[277,39,39,257,278,39],"30544673","jrockway",[280,39,39,257,281,39],"30547169","laurent123456",[283,39,39,257,284,39],"30547587","kodah",[286,39,40,287,288,39],"30548667","project\u002Fcritical\u002Fprivacy","user123456780",[290,39,39,257,291,39],"30549018","junon",[103,40,37,293,104,39],"project\u002Fpositive\u002Fidea",[238,40,39,295,10,40],"maker\u002Fneutral\u002Fpricing",[297,40,32,298,299,39],"30543593","project\u002Fneutral\u002Fpricing","wolfgang42",[130,46,40,301,131,39],"project\u002Fcritical\u002Fexecution",[241,46,39,252,10,40],[304,46,32,305,306,39],"30542054","project\u002Fneutral\u002Fdocs","ejp",[308,46,39,265,10,40],"30542397",[310,46,32,311,312,39],"30544207","maker\u002Fneutral\u002Fidea","pbhjpbhj",[314,46,32,305,315,39],"30545716","thewebcount",[317,46,32,305,318,39],"30548201","vulcan01",[320,32,32,250,321,39],"30542391","gargarplex",[323,32,39,252,10,40],"30542576",[325,42,37,326,327,39],"30547071","project\u002Fpositive\u002Fexecution","Natfan",[172,37,32,329,173,39],"project\u002Fneutral\u002Fdesign",[331,37,39,332,10,40],"30541520","maker\u002Fneutral\u002Fdesign",[118,334,32,335,119,39],6,"project\u002Fneutral\u002Fidea",[337,334,37,293,338,39],"30548366","rmbyrro",[340,17,32,341,342,39],"30540491","project\u002Fneutral\u002Fexecution","wodenokoto",[344,17,32,341,345,39],"30540530","harryvederci",[347,17,32,341,348,39],"30541461","mrlemke",[350,17,39,265,345,39],"30541571",[352,17,39,353,269,39],"30545895","other\u002Fneutral\u002Fnone",[355,17,39,265,348,39],"30564058",[357,17,32,341,358,39],"30540568","cudder",[360,17,39,361,345,39],"30541613","commenter\u002Fneutral\u002Fexecution",[363,17,39,353,364,39],"30542068","pxeger1",[366,17,32,341,367,39],"30540581","nameless912",[176,245,32,369,177,39],"project\u002Fmixed\u002Fdesign",[371,245,39,252,10,40],"30540467",[373,246,32,329,374,39],"30543556","hansott",[376,246,39,252,10,40],"30543617",[378,246,39,265,379,39],"30544721","randomsilence",[381,382,32,341,383,39],"30544840",10,"ghawk1ns",[385,382,39,361,386,39],"30547540","mananaysiempre",[388,33,32,298,389,39],"30540843","dotancohen",[107,30,37,391,108,39],"project\u002Fpositive\u002Fnone",[393,30,39,252,10,40],"30540393",[134,232,40,395,135,39],"project\u002Fcritical\u002Fdocs",[397,232,39,398,10,40],"30548345","maker\u002Fneutral\u002Fdocs",[400,401,40,301,402,39],"30542232",14,"dmix",[404,401,39,405,10,40],"30542385","maker\u002Fneutral\u002Fexecution",[191,407,32,341,192,39],15,[409,407,39,252,10,40],"30540436",[411,412,37,413,299,39],"30543852",16,"maker\u002Fpositive\u002Fnone",[415,412,39,252,10,40],"30544538",[114,417,37,418,115,39],17,"project\u002Fpositive\u002Fdesign",[420,417,39,305,10,40],"30540352",[422,417,32,329,219,39],"30547517",[424,417,32,329,425,39],"30540370","alexrsagen",[207,427,37,418,208,39],18,[429,427,32,329,430,39],"30541359","kordlessagain",[432,427,39,418,10,40],"30541915",[434,427,39,341,10,40],"30542983",[436,437,32,335,438,39],"30541504",19,"eatbitseveryday",[440,437,39,335,10,40],"30541544",[442,443,32,341,444,39],"30539856",20,"kiettv",[77,443,39,341,10,40],[447,443,40,301,338,39],"30540069",[449,443,39,265,450,39],"30540359","cj",[452,443,39,341,10,40],"30540364",[454,443,32,455,456,39],"30540419","project\u002Fneutral\u002Fperformance","marginalia_nu",[458,443,39,455,10,40],"30542471",[460,443,32,455,444,39],"30551503",[462,443,32,455,456,39],"30556341",[180,464,40,465,181,39],21,"project\u002Fcritical\u002Fdesign",[467,464,32,305,444,39],"30539863",[469,464,40,465,108,39],"30539894",[471,464,39,329,10,40],"30539907",[473,464,39,265,474,39],"30548521","genewitch",[476,464,39,329,10,40],"30539898",[146,478,40,301,147,39],22,[480,478,39,341,10,40],"30540250",[482,478,39,341,10,40],"30540310",[218,484,32,305,219,39],23,[486,487,32,335,488,39],"30544393",24,"waynecochran",[490,487,39,335,10,40],"30544474",[492,493,32,335,494,39],"30546019",25,"cbreynoldson",[496,497,32,329,498,39],"30544563",26,"0x20cowboy",[500,501,37,293,502,39],"30539657",27,"amar-laksh",[504,501,39,305,10,40],"30539728",[195,506,32,335,196,39],28,[508,506,39,335,10,40],"30542413",[150,510,40,301,151,39],29,[512,510,39,341,10,40],"30540253",[514,510,39,341,10,40],"30540313",[516,510,37,326,151,39],"30540362",[518,519,37,418,520,39],"30546729",30,"rdiddly",[522,523,40,524,525,39],"30540309",31,"project\u002Fcritical\u002Fidea","bryanrasmussen",[527,523,39,335,10,40],"30540422",[529,530,37,326,531,39],"30543253",32,"leke",[533,534,32,335,535,39],"30543400",33,"sjbrown",[537,534,39,335,10,40],"30543437",[539,534,39,353,540,39],"30544472","all2",[542,231,40,543,544,39],"30541766","project\u002Fcritical\u002Fpricing","baggachipz",[546,231,39,547,10,40],"30541892","commenter\u002Fneutral\u002Fpricing",[549,231,32,295,550,39],"30542157","sdesol",[83,231,39,295,10,40],[553,231,32,295,338,39],"30544823",[555,231,39,265,345,39],"30542153",[557,231,39,265,544,39],"30542819",[70,231,39,335,10,40],[560,231,37,293,540,39],"30544529",[562,231,32,254,563,39],"30547030","rglullis",[565,231,39,353,338,39],"30548411",[567,231,32,254,474,39],"30548561",[569,231,39,265,563,39],"30554764",[],[572,577,582,587,592,596],{"id":573,"name":574,"points":575,"category":576},"30557557","Berkeley Mono Typeface",355,"creative",{"id":578,"name":579,"points":580,"category":581},"30588089","Chalk",286,"dev_tools",{"id":583,"name":584,"points":585,"category":586},"30577625","Blobbackup",236,"infrastructure",{"id":588,"name":589,"points":590,"category":591},"30554994","Summle",189,"games",{"id":593,"name":594,"points":595,"category":591},"30555274","Fast Flood",188,{"id":597,"name":598,"points":599,"category":600},"30612003","Atlantic Money",182,"finance_crypto",false,"v2",{"id":604,"name":5,"line":6,"ai":601,"cat":19,"year":12,"points":13,"comments":14,"rec":27,"s":605,"top":17,"kw":606,"maker":10,"domain":607,"tier":18,"attempts":39,"strip":608,"url":-1,"mix":609,"praise":99,"objection":123,"sub":20},30539620,0.01,[23,24,25,26],"","3000151335433333511554331321133515331353",[30,31,32,33],1793991042117]