[{"data":1,"prerenderedAt":796},["ShallowReactive",2],{"project-29690877":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":34,"aspects":35,"strip":47,"post_text":49,"what":50,"said":86,"maker_in_thread":196,"shape":206,"grid":211,"attempts":759,"same_week":760,"maker_shows":42,"maker_hidden":788,"reader_version":789,"card":790},"29690877","mwmbl","I'm building a non-profit search engine","title","Show HN: I'm building a non-profit search engine","https:\u002F\u002Fgithub.com\u002Fmwmbl\u002Fmwmbl","github.com","daoudc",1640509888,2021,441,199,58,2533,3,"legend","web_saas","search engine","web_app",[21,24,25,26],"non-profit search","open source search","donation funded","curious",-0.014,{"positive":30,"neutral":31,"mixed":32,"critical":33},14,52,0,16,82,{"execution":36,"idea":38,"privacy":41,"pricing":43,"performance":45,"design":46},{"positive":32,"critical":37},7,{"positive":39,"critical":40},9,2,{"positive":42,"critical":32},1,{"positive":32,"critical":44},4,{"positive":18,"critical":42},{"positive":32,"critical":40},[42,40,32,32,32,42,18,18,42,18,18,42,32,42,32,32,18,18,18,18,42,48,48,18,18,48,18,44,40,48,48,32,44,18,18,42,18,44,42,18],5,null,{"problem":51,"audience":49,"pricing":61,"motivation":71,"time_to_build":49,"stack":76,"openness":83,"stage":84,"team_size":85},{"value":52,"source":53,"evidence":54},"Search results are dominated by for-profit engines funded by ads.","inferred",[55,57],{"id":56},"post",{"id":58,"by":59,"text":60},"29691087","KarlKemp","The central problem with this and similar endeavors: nobody is willing to pay what they are worth in ads. Let's say the average Google user in the US earns them $30\u002Fyear. Are you…",{"value":62,"source":63,"evidence":64},"Funded by donations; subscription model considered.","maker",[65,68],{"id":66,"by":11,"text":67},"29691055","The plan is to fund it through donations",{"id":69,"by":11,"text":70},"29691124","Yes, I think a subscription model is the way to go.",{"value":72,"source":53,"evidence":73},"Build a non-profit alternative to ad-funded search.",[74,75],{"id":56},{"id":58,"by":59,"text":60},[77],{"value":78,"source":63,"evidence":79},"Python",[80],{"id":81,"by":11,"text":82},"29692092","Agreed, this was my thinking - and since I'm better at Python, it's faster for me to get stuff done. I would like to rewrite it in Rust though, all help from Rustaceans gladly…","open_source","prototype","unknown",{"praise":87,"objections":107,"requests":129,"questions":148,"alternatives":171},[88,100],{"value":89,"source":90,"evidence":91},"Results are very fast.","commenter",[92,96],{"id":93,"by":94,"text":95},"29690963","tibbar","It’s really fast - nice job! Can you elaborate on the ranking algorithm you are using? It seems that this will become more important as you index more pages.",{"id":97,"by":98,"text":99},"29693707","freediver","Congrats! Very nice to see results being lightning fast, I am getting 100-120ms response with network overhead included and that is impressive. The payload size of only 10-20kb…",{"value":101,"source":90,"evidence":102},"Non-profit search engines are needed.",[103],{"id":104,"by":105,"text":106},"29691967","marcodiego","Non-profit search engines are needed. It will probably still be vulnerable to SEO but will more likely be resistant to become corrupt by the interest of \"investors\".",[108,115,123],{"value":109,"source":90,"evidence":110},"Search results are not sensible for many queries.",[111],{"id":112,"by":113,"text":114},"29691184","Closi","Hey, great project - the more competition in this space the better. To be honest, at the moment the algorithm doesn't return any sensible results for anything (at least that I…",{"value":116,"source":90,"evidence":117},"Donation funding may not cover running costs.",[118,122],{"id":119,"by":120,"text":121},"29691061","amenod","Off-topic [0]: I would be very interested in an economic model that would work for such a search engine. Donations are fine, but (imho) it will take much more than that to keep…",{"id":58,"by":59,"text":60},{"value":124,"source":63,"evidence":125},"Index is too small.",[126],{"id":127,"by":11,"text":128},"29696612","Thanks for the detailed feedback! I think most of most of the problems here are because we have a really small index right now. Increasing the number of documents is our top…",[130,141],{"value":131,"source":90,"evidence":132},"Distributed crawler via browser extension or contributed browsing data.",[133,137],{"id":134,"by":135,"text":136},"29691820","tomxor","> We plan to start work on a distributed crawler, probably implemented as a browser extension that can be installed by volunteers. Is there a concern that volunteers could…",{"id":138,"by":139,"text":140},"29691114","smt88","Can you make it a contributory database? I wouldn't mind \"donating\" my browsing history and page downloads to build the index and train the algorithm. You'd have to find a way to…",{"value":142,"source":90,"evidence":143},"Open source with a community and foundation governance.",[144],{"id":145,"by":146,"text":147},"29695461","WheelsAtLarge","Make it open source and syndicate it. The goal is to get people to contribute both resources and code. Think about the Shopify as the model. Where many people contribute to…",[149,156,160],{"value":150,"source":90,"evidence":151},"Why Python rather than a faster language?",[152],{"id":153,"by":154,"text":155},"29691396","wolfgarbe","A laudable effort. Two questions: 1. What is the rationale behind choosing Python as a implementation language? Performance and efficiency are paramount in keeping operational…",{"value":157,"source":90,"evidence":158},"Why not use existing open source engines like Lucene or Solr?",[159],{"id":153,"by":154,"text":155},{"value":161,"source":90,"evidence":162},"How is the index stored and how much compute is needed?",[163,167],{"id":164,"by":165,"text":166},"29690996","montebicyclelo","How much compute, storage, and network speed would a minimal up-to-date web search engine need?",{"id":168,"by":169,"text":170},"29694773","aantix","How does someone economically store tens if thousands of terabytes of data needed for the indexes of a large scale search engine? And have the large server instances (lots of ram)?",[172,179,185,189],{"value":173,"source":90,"evidence":174},"Marginalia Search",[175],{"id":176,"by":177,"text":178},"29691182","ortuman84","> Marginalia Search is fantastic, but it is more of a personal project than an open source community. And where's the community behind mwmbl project?",{"value":180,"source":90,"evidence":181},"YaCy",[182],{"id":183,"by":11,"text":184},"29691130","Check out YaCy. It's great if you're happy with slow search!",{"value":186,"source":90,"evidence":187},"DuckDuckGo",[188],{"id":112,"by":113,"text":114},{"value":190,"source":90,"evidence":191},"Ecosia",[192],{"id":193,"by":194,"text":195},"29691247","legofr","> All other search engines that I've come across are for-profit. Please let me know if I've missed one! https:\u002F\u002Fwww.ecosia.org\u002F https:\u002F\u002Fask.moe\u002F https:\u002F\u002Fekoru.org\u002F I remember…",{"comments":197,"answered":30,"key":198},24,[199,202,205],{"id":200,"text":201},"29691203","Thanks for the feedback! I'll take a look at your examples and see if I can improve the rankings.",{"id":203,"text":204},"29700806","While search funds most of Google, most employees at Google don't work on search. A small proportion of Google's revenue would be plenty for good quality search.",{"id":127,"text":128},{"commenters":207,"max_depth":208,"maker_replies":197,"first_comment_mins":209,"lifespan_hours":210},124,8,27,128,[212,214,216,219,223,226,230,233,236,239,242,246,250,254,257,261,263,265,269,272,275,277,279,282,285,287,290,292,294,296,298,300,303,306,309,311,314,317,320,323,325,327,330,333,336,338,340,344,347,349,353,356,359,362,364,365,368,371,374,376,378,381,384,387,390,393,395,398,400,404,407,411,414,417,420,424,427,429,432,437,440,443,446,449,452,454,457,460,463,466,470,473,475,477,480,483,485,488,492,495,498,500,502,504,507,508,511,514,517,519,521,524,526,529,531,535,538,541,545,546,548,551,553,557,560,562,565,568,570,574,576,578,580,582,586,589,591,593,597,599,602,605,606,607,610,612,615,617,619,621,623,625,627,629,632,635,637,639,641,644,646,649,651,653,655,658,660,663,666,668,670,673,675,679,683,687,690,693,696,698,702,704,706,708,711,715,719,723,727,729,732,734,736,738,742,745,748,751,755],[112,32,42,213,113,32],"project\u002Fcritical\u002Fexecution",[200,32,32,215,11,42],"maker\u002Fneutral\u002Fnone",[217,32,42,213,218,32],"29691222","devoutsalsa",[220,32,32,221,222,32],"29694176","commenter\u002Fneutral\u002Fdocs","rmbyrro",[224,32,42,213,225,32],"29691498","GraemeMeyer",[227,32,18,228,229,32],"29691868","project\u002Fneutral\u002Fidea","clay-dreidels",[231,32,18,228,232,32],"29691955","marginalia_nu",[234,32,32,235,222,32],"29694208","other\u002Fneutral\u002Fpricing",[237,32,32,235,238,32],"29696939","bigyikes",[240,32,32,235,241,32],"29696986","_benj",[243,32,32,244,245,32],"29697079","commenter\u002Fneutral\u002Fnone","danuker",[247,32,32,248,249,32],"29697142","other\u002Fneutral\u002Fnone","berkut",[251,32,32,252,253,32],"29697351","commenter\u002Fneutral\u002Fprivacy","tamrix",[255,32,32,248,256,32],"29697522","blakewatson",[258,32,32,259,260,32],"29697556","other\u002Fpositive\u002Fpricing","divmain",[262,32,32,248,222,32],"29698130",[264,32,32,244,98,32],"29698206",[266,32,32,267,268,32],"29698501","other\u002Fneutral\u002Fprivacy","6510",[270,32,32,248,271,32],"29697745","rezonant",[273,32,32,235,274,32],"29697769","gundmc",[276,32,32,235,222,32],"29698118",[203,32,32,278,11,42],"maker\u002Fneutral\u002Fidea",[280,32,32,235,281,32],"29699816","quickthrower2",[283,32,32,235,284,32],"29729429","lenkite",[286,32,32,248,268,32],"29698404",[288,32,42,213,289,32],"29694842","gjm11",[127,32,32,291,11,42],"maker\u002Fneutral\u002Fexecution",[293,32,42,213,113,32],"29696758",[295,32,32,291,11,42],"29700832",[134,42,18,297,135,32],"project\u002Fneutral\u002Fprivacy",[299,42,32,215,11,42],"29692073",[301,42,18,215,302,32],"29692921","Schiendelman",[304,42,32,244,305,32],"29703182","bryguy32403",[307,42,32,267,308,32],"29692414","altdataseller",[310,42,32,244,135,32],"29693427",[312,42,18,297,313,32],"29692536","qwertox",[315,42,18,316,135,32],"29693447","project\u002Fneutral\u002Fnone",[318,42,18,316,319,32],"29693601","dreamcompiler",[321,42,18,316,322,32],"29693611","imglorp",[58,40,42,324,59,32],"project\u002Fcritical\u002Fpricing",[326,40,32,215,11,42],"29691167",[328,40,32,244,329,32],"29691232","dazc",[331,40,32,332,329,32],"29691216","other\u002Fneutral\u002Fperformance",[334,40,32,244,335,32],"29691295","nyuszika7h",[337,40,32,244,329,32],"29691341",[339,40,32,248,335,32],"29691285",[341,40,18,342,343,32],"29691713","project\u002Fneutral\u002Fpricing","timeon",[345,40,32,346,59,32],"29696498","commenter\u002Fneutral\u002Fpricing",[153,18,18,348,154,32],"project\u002Fneutral\u002Fexecution",[350,18,32,351,352,32],"29691715","commenter\u002Fneutral\u002Fperformance","Faaak",[354,18,32,351,355,32],"29691747","authed",[357,18,32,351,358,32],"29691774","nulbyte",[360,18,18,361,232,32],"29691860","project\u002Fneutral\u002Fperformance",[363,18,32,351,154,32],"29692024",[81,18,32,291,11,42],[366,18,32,351,367,32],"29692451","Debug_Overload",[369,18,32,351,370,32],"29692868","stevenally",[372,18,32,351,373,32],"29702195","thatwasunusual",[193,44,42,375,194,32],"project\u002Fcritical\u002Fidea",[377,44,32,278,11,42],"29691306",[379,44,32,244,380,32],"29691870","toper-centage",[382,44,32,244,383,32],"29695255","gardenfelder",[385,44,32,248,386,32],"29692117","asicsp",[388,44,32,248,389,32],"29692511","m-i-l",[391,44,32,248,392,32],"29695610","mlinksva",[394,44,32,215,11,42],"29700846",[396,44,32,248,397,32],"29695971","Minor49er",[399,44,32,248,232,32],"29697740",[401,48,42,402,403,32],"29691080","project\u002Fcritical\u002Fdesign","alexdowad",[405,48,32,406,11,42],"29691109","project\u002Fneutral\u002Fdesign",[408,48,32,409,410,32],"29691141","commenter\u002Fneutral\u002Fdesign","yetanother-1",[412,48,32,409,413,32],"29691168","danpalmer",[415,48,32,244,416,32],"29691263","jesprenj",[418,48,32,409,419,32],"29691803","scottmcdot",[421,48,32,422,423,32],"29691152","other\u002Fneutral\u002Fdesign","wodenokoto",[425,48,32,248,426,32],"29691598","thenthenthen",[428,48,32,248,232,32],"29691966",[430,48,32,248,431,32],"29692516","KnobbleMcKnees",[433,434,32,435,436,32],"29691603",6,"other\u002Fneutral\u002Fidea","ZeroGravitas",[438,434,32,248,439,32],"29691625","yellowsir",[441,434,32,248,442,32],"29691710","medstrom",[444,434,32,248,445,32],"29692754","bluecatswim",[447,37,18,228,448,32],"29691134","igammarays",[450,37,18,228,451,32],"29691142","thebeastie",[453,37,18,228,448,32],"29691153",[455,37,18,228,456,32],"29691520","born-jre",[458,37,18,228,459,32],"29691172","b3kart",[461,37,18,228,462,32],"29691198","hericium",[464,37,18,228,465,32],"29691423","GistNoesis",[467,37,32,468,469,32],"29691493","commenter\u002Fcritical\u002Fidea","charcircuit",[471,37,32,472,465,32],"29691542","commenter\u002Fneutral\u002Fidea",[474,37,32,472,469,32],"29691865",[476,37,32,472,465,32],"29692664",[478,37,18,228,479,32],"29691558","zomglings",[481,37,42,375,482,32],"29691653","bspammer",[484,37,32,472,479,32],"29691755",[486,37,32,248,487,32],"29693547","DarylZero",[489,37,48,490,491,32],"29691240","project\u002Fpositive\u002Fidea","g105b",[493,37,18,228,494,32],"29691502","Piezoid",[496,37,42,497,448,32],"29691773","project\u002Fcritical\u002Fperformance",[499,37,42,213,232,32],"29691888",[501,37,18,228,451,32],"29695263",[503,37,18,228,451,32],"29695858",[505,37,32,468,506,32],"29695875","detaro",[145,208,18,228,146,32],[509,39,48,490,510,32],"29691387","ChemSpider",[512,39,32,244,513,32],"29700424","challenger-derp",[93,515,48,516,94,32],10,"project\u002Fpositive\u002Fperformance",[518,515,32,348,11,42],"29691016",[520,515,32,228,11,42],"29691098",[522,515,48,490,523,32],"29691303","foxfluff",[525,515,32,278,11,42],"29691325",[527,515,48,490,528,32],"29692786","ffhhj",[530,515,18,361,513,32],"29700458",[532,533,42,402,534,32],"29697327",11,"rascul",[536,533,32,537,11,42],"29700912","maker\u002Fneutral\u002Fdesign",[539,540,32,215,11,42],"29696585",12,[542,543,48,490,544,32],"29692442",13,"gkasev",[119,30,18,342,120,32],[547,30,32,342,11,42],"29691076",[549,30,42,324,550,32],"29691123","klohto",[552,30,32,278,11,42],"29691136",[554,30,48,555,556,32],"29691267","maker\u002Fpositive\u002Fnone","abraae",[558,30,32,346,559,32],"29692412","oefrha",[561,30,32,472,423,32],"29691159",[563,30,32,472,564,32],"29691202","interator7",[566,30,18,342,567,32],"29691091","luckylion",[69,30,32,569,11,42],"maker\u002Fneutral\u002Fpricing",[571,30,48,572,573,32],"29691262","project\u002Fpositive\u002Fprivacy","hosteur",[575,30,18,342,232,32],"29691898",[577,30,32,569,11,42],"29692109",[579,30,18,342,232,32],"29692371",[581,30,18,342,389,32],"29693054",[583,584,18,228,585,32],"29692036",15,"quantum2021",[587,33,18,228,588,32],"29694126","gravypod",[104,590,48,490,105,32],17,[97,592,48,516,98,32],18,[594,595,18,228,596,32],"29696034",19,"ChuckMcM",[164,598,18,361,165,32],20,[600,598,42,324,601,32],"29691008","iopq",[603,598,18,342,604,32],"29691032","dotancohen",[66,598,32,569,11,42],[138,598,18,297,139,32],[608,598,18,228,609,32],"29691310","aspenmayer",[611,598,32,278,11,42],"29691356",[613,598,48,490,614,32],"29691081","hirako2000",[183,598,32,616,11,42],"other\u002Fcritical\u002Fnone",[618,598,32,332,416,32],"29691281",[620,598,32,248,469,32],"29691508",[622,598,48,490,604,32],"29691446",[624,598,18,228,614,32],"29691523",[626,598,32,472,604,32],"29691580",[628,598,32,472,614,32],"29711782",[630,598,32,351,631,32],"29691099","arpa",[633,598,32,351,634,32],"29691225","adtac",[636,598,32,472,113,32],"29691473",[638,598,32,472,634,32],"29691524",[640,598,32,472,523,32],"29691840",[642,598,32,472,643,32],"29692712","noogle",[645,598,48,516,232,32],"29691913",[647,598,18,361,648,32],"29692098","daibo",[650,598,18,361,232,32],"29692242",[652,598,18,361,648,32],"29692563",[654,598,18,361,232,32],"29692637",[656,598,32,351,657,32],"29697754","anonred",[659,598,32,351,232,32],"29700676",[661,598,32,351,662,32],"29692434","ValleZ",[664,598,18,361,665,32],"29693004","dqv",[667,598,32,351,662,32],"29693383",[669,598,32,351,665,32],"29699235",[671,598,32,248,672,32],"29693870","fauigerzigerk",[674,598,32,244,662,32],"29696783",[676,677,18,297,678,32],"29695602",21,"kova12",[680,681,32,248,682,32],"29734792",22,"lovefeature",[684,685,18,228,686,32],"29695151",23,"champagnois",[688,197,42,324,689,32],"29691947","prohobo",[691,197,32,346,692,32],"29692068","everydaybro",[694,197,32,472,695,32],"29692956","astoor",[697,197,32,346,689,32],"29693223",[699,700,18,316,701,32],"29691828",25,"btdmaster",[703,700,32,215,11,42],"29692118",[176,705,18,316,177,32],26,[707,705,32,215,11,42],"29691205",[709,209,32,248,710,32],"29691534","slmjkdbtl",[712,713,32,435,714,32],"29691879",28,"juliushuijnk",[716,717,18,361,718,32],"29699874",29,"emrah",[720,721,48,490,722,32],"29702981",30,"reacharavindh",[724,725,32,435,726,32],"29692749",31,"marban",[168,728,18,361,169,32],32,[730,728,32,248,731,32],"29694858","supernovae",[733,728,18,228,169,32],"29711497",[735,728,32,351,731,32],"29749822",[737,728,32,351,232,32],"29695072",[739,740,42,213,741,32],"29692216",33,"tmnstr85",[743,740,32,244,744,32],"29692230","AlphaWeaver",[746,740,18,342,747,32],"29692274","blueatlas",[749,750,32,248,456,32],"29691553",34,[752,753,18,361,754,32],"29691340",35,"discordance",[756,757,18,228,758,32],"29691683",36,"amelius",[],[761,766,771,776,781,784],{"id":762,"name":763,"points":764,"category":765},"29726787","Voiceliner",297,"productivity",{"id":767,"name":768,"points":769,"category":770},"29715464","ntfy",241,"infrastructure",{"id":772,"name":773,"points":774,"category":775},"29729335","Wall of Text",145,"learning_science",{"id":777,"name":778,"points":779,"category":780},"29705794","Drovp",105,"dev_tools",{"id":782,"name":783,"points":779,"category":770},"29711433","Uptrace",{"id":785,"name":786,"points":787,"category":765},"29703671","Alfread",104,false,"v2",{"id":791,"name":5,"line":6,"ai":788,"cat":20,"year":13,"points":14,"comments":15,"rec":27,"s":792,"top":18,"kw":793,"maker":11,"domain":10,"tier":19,"attempts":32,"strip":794,"url":9,"mix":795,"praise":89,"objection":109,"sub":21},29690877,-0.01,[21,24,25,26],"1200013313310100333315533534255043313413",[30,31,32,33],1794036614566]