[{"data":1,"prerenderedAt":830},["ShallowReactive",2],{"project-3910304":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":34,"aspects":35,"strip":46,"post_text":48,"what":49,"said":75,"maker_in_thread":201,"shape":213,"grid":218,"attempts":789,"same_week":794,"maker_shows":47,"maker_hidden":823,"reader_version":824,"card":825},"3910304","Million Short","Imagine a search engine that removed top million sites from its index","title","Show HN: Imagine a search engine that removed top million sites from its index","http:\u002F\u002Fmillionshort.com\u002Fabout.html","millionshort.com","taxonomyman",1335807351,2012,552,195,3,1677,1,"legend","data","search engine","web_app",[21,24,25,26],"alexa top million","web discovery","hidden gems","debated",0.11,{"positive":30,"neutral":31,"mixed":32,"critical":33},46,31,4,37,118,{"execution":36,"idea":39,"docs":41,"design":43,"performance":44},{"positive":37,"critical":38},8,17,{"positive":40,"critical":38},34,{"positive":42,"critical":42},0,{"positive":42,"critical":18},{"positive":45,"critical":45},2,[47,32,16,16,45,42,47,42,42,18,47,47,45,16,18,47,16,16,47,45,45,32,47,45,47,32,32,47,16,45,18,18,32,45,18,16,32,18,47,18],5,null,{"problem":50,"audience":48,"pricing":48,"motivation":65,"time_to_build":48,"stack":72,"openness":73,"stage":74,"team_size":73},{"value":51,"source":52,"evidence":53},"Popular sites dominate search results, hiding lesser-known pages","commenter",[54,58,62],{"id":55,"by":56,"text":57},"3910850","swalsh","The results are surprisingly good. I did some searches for recipes, and frankly without the top 1000 you really start getting some fresh hits. Entries by real people, rather than…",{"id":59,"by":60,"text":61},"3910780","yayadarsh","After a few test searches, this is surprisingly effective for things which I had resigned \"un-findable\" because of poor Google results. This is most apparent on non-technical…",{"id":63,"by":11,"text":64},"3911188","They are to a degree. We just remove remove the top million most popular sites. So, searching for \"social network\" would normally yield Facebook.com, but with MillionShort you…",{"value":66,"source":67,"evidence":68},"Find information buried under popular sites, treating un-findable content as a gold mine","maker",[69],{"id":70,"by":11,"text":71},"3910825","That was exactly the goal. In our opinion the \"un-findable\" as you put it represents a gold mine of information yet to be absorbed and enjoyed.",[],"unknown","launched",{"praise":76,"objections":100,"requests":134,"questions":166,"alternatives":178},[77,89],{"value":78,"source":52,"evidence":79},"Surfaces fresh, human-written pages instead of SEO content",[80,81,85],{"id":55,"by":56,"text":57},{"id":82,"by":83,"text":84},"3911445","heydonovan","I'm really liking this. Instead of being bombarded with content that's just blasted with keywords, I get relevant well-written articles. Not only that, but no more W3Schools in…",{"id":86,"by":87,"text":88},"3911475","serbrech","The results feel actually fresh. It's removing the consumerism layer of bullshit that google serves us everyday. Also wondering if that has something to do with the \"bubble\" that…",{"value":90,"source":52,"evidence":91},"Finds old-internet and obscure sites",[92,96],{"id":93,"by":94,"text":95},"3911382","libraryatnight","This reminds of searching the internet in the 90's, I'm finding results from pages I haven't visited or heard of before now. This is really refreshing.",{"id":97,"by":98,"text":99},"3911683","pessimizer","This is pretty amazing. I didn't know that the old internet was still there! This may become my new favorite search engine.",[101,110,119],{"value":102,"source":67,"evidence":103},"Filtering is incomplete for non .com\u002F.net\u002F.org domains such as .gov.au",[104,107],{"id":105,"by":11,"text":106},"3910603","Good feedback. Right now the filtering is not 100% working for non .com, .net, .org, .co.uk domains. Still working on it.",{"id":108,"by":11,"text":109},"3910748","Right now the filtering is not 100% working for non .com, .net, .org, .co.uk domains. So, .gov.au isn't being properly filtered yet. Soon.",{"value":111,"source":67,"evidence":112},"Popular sites like W3Schools and Google still appear through subdomains or redirects",[113,116],{"id":114,"by":11,"text":115},"3910773","Your're right. We strip www from the domains. We need a better function to rip out the domain from a URL. Just haven't had time to cook one up yet.",{"id":117,"by":11,"text":118},"3910759","merriam-webster.com redirects to m-w.com - looking into the others.. Sometimes if a site has header redirects it gets lost in the filters. Thx for pointing this out.",{"value":120,"source":52,"evidence":121},"Searches for brand names or the user's own site return unrelated results",[122,126,130],{"id":123,"by":124,"text":125},"3911779","hybrid11","This is a cool search engine for discovery, but it defeats the purpose when you are looking for a location. Do a search for \"facebook\", you will not get any result that links you…",{"id":127,"by":128,"text":129},"3911412","bstar77","There's one pretty big flaw with this approach... For certain searches that do not have \"millions of results\", you get completely unrelated results. If I search my name then the…",{"id":131,"by":132,"text":133},"3911972","Ben_Burke","i searched for my site and in teh goog i get first page....here i found nothing....so for me this = no good. I understand the base but i dont understand the result",[135,146,157],{"value":136,"source":52,"evidence":137},"Keep the search text after searching",[138,142],{"id":139,"by":140,"text":141},"3910941","pfarrell","I would prefer if my previous search was populated in the search box after completing a search (since I might want to try the search with a different filter). It appears you have…",{"id":143,"by":144,"text":145},"3911837","garraeth","I love this! And am totally going to use it. Removing the top \"thousand sites\" removes pretty much all the sites I WISH I could have filtered from my Google results anyhow (ehow,…",{"value":147,"source":52,"evidence":148},"Add to Firefox search bar",[149,153],{"id":150,"by":151,"text":152},"3912339","unimpressive","Add a way for me to put this as my search engine in my firefox search bar. Please. EDIT: In trying to accomplish this task I found an add-on that lets you do this for anything.…",{"id":154,"by":155,"text":156},"3911777","qwertyz","Now if I could add it to firefox's search bar...",{"value":158,"source":67,"evidence":159},"Allow include and exclude site lists",[160,163],{"id":161,"by":11,"text":162},"3910845","You are right, but they won't allow the list to be 1 million sites long. You are talking 15 megs of data per data in plain text per request. But I like the idea of being able for…",{"id":164,"by":11,"text":165},"3910989","A few of the suggestions included the ability to set include\u002Fexclude sites which I think we'll add.",[167],{"value":168,"source":52,"evidence":169},"How is the site built and where does the index come from",[170,174],{"id":171,"by":172,"text":173},"3910689","felixchan","How did you build this? Are you indexing the entire web yourself? Or are you using Google's index\u002Fremoving the top 1 million based on domain?",{"id":175,"by":176,"text":177},"3910749","pbhjpbhj","Would you share some implementation details. What's your source for the top million sites; where do you get your site list from for the other results?",[179,190],{"value":180,"source":52,"evidence":181},"Google",[182,186],{"id":183,"by":184,"text":185},"3910366","bicknergseng","Turns out removing the top million results from a search for Google... still returns google. Or google.com.au to be precise. It's a cool idea, but I'm not sure it's working. I…",{"id":187,"by":188,"text":189},"3910642","Cushman","I'd be fascinated to see the kind of SEO that would go on if this took off. \"Bad news-- we're a top 100 hit for several of our main keywords. We'll have to change our URL scheme…",{"value":191,"source":52,"evidence":192},"DuckDuckGo",[193,197],{"id":194,"by":195,"text":196},"3911675","cnbeuiwx","Thank you - very refreshing! DuckDuckGo should implement something like this just for the spirit of it. The web just got more interesting. :)",{"id":198,"by":199,"text":200},"3911987","halle_lu_jah","Here's what Dropbox thinks about power users: WSJ: What's next? Mr. Ferdowsi: We continue to focus on actually solving problems that real people have and not being distracted by…",{"comments":202,"answered":16,"key":203},30,[204,207,210],{"id":205,"text":206},"3910910","We're surprising ourselves too.",{"id":208,"text":209},"3911511","Maybe think of Million Short as more of a discovery engine. We're not saying a quality site can't be popular.",{"id":211,"text":212},"3911302","Thanks for the great comparison.",{"commenters":214,"max_depth":215,"maker_replies":202,"first_comment_mins":216,"lifespan_hours":217},138,10,11,134,[219,221,223,226,230,234,236,240,244,247,251,254,257,260,263,266,269,272,275,278,282,285,288,291,294,297,299,302,305,308,311,313,316,319,322,325,328,330,332,334,336,338,341,344,345,348,351,354,357,360,363,364,368,370,373,376,380,382,385,387,389,390,392,394,397,399,402,404,408,410,412,416,419,421,423,427,429,432,435,437,439,443,445,447,450,454,455,458,461,463,464,467,470,472,476,477,480,484,486,489,492,494,497,500,502,506,509,513,515,517,520,524,525,527,531,535,537,540,544,547,551,555,557,560,564,566,570,572,575,576,579,583,585,587,592,593,598,602,603,605,609,610,615,618,621,625,627,629,633,637,639,642,645,648,650,653,657,660,664,668,672,675,679,683,687,692,696,700,702,705,707,711,713,715,718,722,726,728,732,736,740,742,744,747,749,753,757,759,762,766,770,774,778,782,786],[55,42,47,220,56,42],"project\u002Fpositive\u002Fexecution",[205,42,42,222,11,18],"maker\u002Fneutral\u002Fnone",[224,42,47,220,225,42],"3910929","shawnc",[227,42,16,228,229,42],"3911418","project\u002Fneutral\u002Fidea","hkmurakami",[231,18,16,232,233,42],"3911470","project\u002Fmixed\u002Fidea","nostromo",[208,18,42,235,11,18],"maker\u002Fneutral\u002Fidea",[237,18,47,238,239,42],"3914972","project\u002Fpositive\u002Fidea","copper",[241,18,42,242,243,42],"3916837","other\u002Fneutral\u002Fnone","tripzilch",[245,18,16,228,246,42],"3911747","mayneack",[248,18,16,249,250,42],"3911879","project\u002Fneutral\u002Fnone","lubujackson",[252,18,42,242,253,42],"3912432","thebigshane",[255,18,42,242,256,42],"3911833","afhof",[258,18,42,242,259,42],"3911901","PBxdId7wFr",[261,18,42,242,262,42],"3912607","evoxed",[264,18,42,242,265,42],"3912660","waterlesscloud",[267,18,42,242,268,42],"3912734","btopham",[270,18,42,242,271,42],"3912992","sciurus",[273,18,42,242,274,42],"3912066","ricardobeat",[276,18,16,228,277,42],"3912938","SkyMarshal",[279,18,18,280,281,42],"3913697","project\u002Fcritical\u002Fidea","NLips",[283,18,42,242,284,42],"3913154","meatsock",[286,18,18,280,287,42],"3914012","sparknlaunch12",[289,45,47,238,290,42],"3910928","zeratul",[292,45,42,242,293,42],"3910956","RegEx",[295,45,42,242,296,42],"3911387","rudiger",[298,45,42,242,293,42],"3911458",[300,45,42,242,301,42],"3913573","robryan",[303,45,42,242,304,42],"3911104","_delirium",[306,45,42,242,307,42],"3911233","brudgers",[309,16,47,238,310,42],"3911262","PaulHoule",[211,16,42,312,11,18],"commenter\u002Fneutral\u002Fnone",[314,16,47,238,315,42],"3911303","jaems33",[317,16,16,232,318,42],"3911353","erichocean",[320,16,42,242,321,42],"3911490","noahc",[323,16,42,242,324,42],"3911582","hello_asdf",[326,16,42,242,327,42],"3913372","dsrguru",[329,16,42,242,321,42],"3913934",[331,16,42,242,327,42],"3915121",[333,16,42,242,321,42],"3918499",[335,16,42,242,327,42],"3934399",[337,16,42,242,243,42],"3918035",[339,16,42,242,340,42],"3911502","borism",[342,16,42,242,343,42],"3913567","alan_cx",[187,32,18,280,188,42],[346,32,18,280,347,42],"3910694","ssharp",[349,32,18,280,350,42],"3910797","jpk",[352,32,42,312,353,42],"3913412","arb99",[355,32,42,242,356,42],"3911176","Bud",[358,32,42,242,359,42],"3911203","knewter",[361,32,42,242,362,42],"3911666","hoprocker",[93,47,47,238,94,42],[365,366,47,238,367,42],"3910770",6,"eliasmacpherson",[369,366,42,222,11,18],"3910782",[175,371,16,372,176,42],7,"project\u002Fneutral\u002Fdocs",[374,37,47,238,375,42],"3912954","goodgracious",[377,378,47,220,379,42],"3910677",9,"waivej",[381,378,42,222,11,18],"3910685",[383,378,47,220,384,42],"3911933","mburshteyn",[183,215,18,386,184,42],"project\u002Fcritical\u002Fexecution",[105,215,42,388,11,18],"maker\u002Fneutral\u002Fexecution",[127,216,18,386,128,42],[391,216,42,222,11,18],"3911434",[393,216,47,220,128,42],"3911462",[395,396,47,238,293,42],"3910580",12,[398,396,42,312,11,18],"3910591",[400,396,18,386,401,42],"3910878","pash",[403,396,42,312,293,42],"3910945",[405,396,16,406,407,42],"3911501","project\u002Fneutral\u002Fexecution","romaniv",[409,396,18,386,362,42],"3911663",[411,396,18,386,301,42],"3913581",[413,414,16,228,415,42],"3911638",13,"bane",[417,414,18,280,418,42],"3911886","robrenaud",[420,414,42,312,415,42],"3912412",[86,422,47,238,87,42],14,[424,425,47,220,426,42],"3911193",15,"hafabnew",[82,428,47,220,83,42],16,[430,38,42,431,199,42],"3912094","commenter\u002Fneutral\u002Fidea",[150,433,16,434,151,42],18,"project\u002Fneutral\u002Fdesign",[436,433,42,312,11,18],"3912409",[198,438,47,238,199,42],19,[440,441,18,280,442,42],"3910837",20,"__alexs",[444,441,42,235,11,18],"3910898",[446,441,47,238,407,42],"3911329",[448,441,42,449,442,42],"3913456","other\u002Fneutral\u002Fidea",[451,452,18,386,453,42],"3910752",21,"tnorthcutt",[114,452,42,388,11,18],[456,452,16,406,457,42],"3913191","mattj",[459,452,18,386,460,42],"3913927","EvilTerran",[59,462,47,238,60,42],22,[70,462,42,235,11,18],[465,462,47,220,466,42],"3912729","cjlars",[468,469,47,238,318,42],"3911158",23,[471,469,42,222,11,18],"3911190",[473,474,18,386,475,42],"3910723",24,"wonderwhy",[108,474,42,388,11,18],[478,474,16,406,479,42],"3911799","slyall",[481,482,16,228,483,42],"3910651",25,"bo1024",[485,482,42,235,11,18],"3910661",[487,482,18,280,488,42],"3913223","jQueryIsAwesome",[490,482,18,280,491,42],"3910886","shazow",[493,482,42,235,11,18],"3910907",[495,482,47,238,496,42],"3911468","MichaelApproved",[498,482,16,228,499,42],"3911513","mmahemoff",[501,482,16,434,499,42],"3911499",[503,504,16,249,505,42],"3911551",26,"scoot",[507,504,42,312,508,42],"3911827","Alexandervn",[510,511,47,238,512,42],"3911029",27,"wazoox",[139,514,18,386,140,42],28,[516,514,42,388,11,18],"3910952",[518,514,47,519,140,42],"3911447","maker\u002Fpositive\u002Fidea",[521,522,47,238,523,42],"3912143",29,"twelvechairs",[97,202,47,238,98,42],[526,31,18,280,199,42],"3912194",[528,529,47,238,530,42],"3911671",32,"charlieok",[532,533,16,228,534,42],"3911016",33,"martinaglv",[536,533,18,386,496,42],"3911491",[538,533,42,312,539,42],"3911695","SquareWheel",[541,40,47,542,543,42],"3911687","project\u002Fpositive\u002Fnone","pjin",[545,40,42,242,546,42],"3912002","dools",[548,549,47,238,550,42],"3912368",35,"vidoss",[552,553,47,238,554,42],"3910762",36,"g_lined",[556,553,42,406,11,18],"3910785",[558,33,47,238,559,42],"3911201","jtchang",[561,562,18,386,563,42],"3910648",38,"chrislomax",[565,562,42,222,11,18],"3910707",[567,568,47,238,569,42],"3912561",39,"Suncho",[171,571,16,388,172,42],40,[573,571,16,406,574,42],"3910733","wildmXranat",[161,571,42,406,11,18],[577,571,42,449,578,42],"3914904","shurane",[580,581,47,238,582,42],"3913992",41,"mswen",[143,584,47,238,144,42],42,[194,586,47,238,195,42],43,[588,589,18,590,591,42],"3910977",44,"project\u002Fcritical\u002Fperformance","fibbery",[164,589,42,228,11,18],[594,595,47,596,597,42],"3911481",45,"project\u002Fpositive\u002Fperformance","83457",[599,30,16,600,601,42],"3910744","project\u002Fmixed\u002Fexecution","selectout",[117,30,42,406,11,18],[604,30,47,238,601,42],"3910788",[606,607,18,280,608,42],"3911164",47,"dclowd9901",[63,607,42,228,11,18],[611,612,16,613,614,42],"3910620",48,"project\u002Fmixed\u002Fdocs","duck",[616,612,16,406,617,42],"3910678","zenpaul",[619,612,42,242,620,42],"3910763","dahumpty",[622,623,18,280,624,42],"3910479",49,"tocomment",[626,623,42,235,11,18],"3910625",[628,623,16,228,624,42],"3918787",[630,631,18,386,632,42],"3912037",50,"doktrin",[634,631,42,635,636,42],"3912423","commenter\u002Fneutral\u002Fexecution","prawn",[123,638,18,280,124,42],51,[640,638,42,242,641,42],"3911851","kevinrpope",[643,638,42,242,644,42],"3913293","djeikyb",[646,638,42,242,647,42],"3913403","sanxiyn",[649,638,42,242,644,42],"3926705",[651,652,18,386,307,42],"3911725",52,[654,655,16,434,656,42],"3911265",53,"radley",[658,655,42,659,11,18],"3911390","maker\u002Fneutral\u002Fdesign",[661,662,47,238,663,42],"3913178",54,"ChristianMarks",[665,666,18,280,667,42],"3911680",55,"zecho",[669,670,47,596,671,42],"3910849",56,"mserdarsanli",[673,670,42,674,11,18],"3910860","maker\u002Fpositive\u002Fnone",[676,677,47,542,678,42],"3911843",57,"thorin_2",[680,681,16,249,682,42],"3912054",58,"Tossrock",[684,685,18,386,686,42],"3910754",59,"carlosaguayo",[688,689,18,690,691,42],"3911614",60,"project\u002Fcritical\u002Fdesign","grampajoe",[693,694,16,228,695,42],"3912196",61,"dude123122",[697,698,18,590,699,42],"3910536",62,"rogerbinns",[701,698,42,235,11,18],"3910553",[703,698,42,431,704,42],"3910576","anigbrowl",[706,698,42,431,11,18],"3910616",[708,709,18,280,710,42],"3910925",63,"mathetic",[712,709,42,235,11,18],"3910936",[714,709,16,249,246,42],"3911814",[716,717,42,659,11,18],"3911739",64,[719,720,47,238,721,42],"3911692",65,"it",[723,724,16,222,725,42],"3911539",66,"hsparikh",[727,724,16,406,250,42],"3915455",[729,730,47,238,731,42],"3915366",67,"pnathan",[733,734,47,238,735,42],"3911808",68,"wyck",[737,738,18,280,739,42],"3911227",69,"pazimzadeh",[741,738,16,434,307,42],"3911258",[743,738,18,280,407,42],"3911277",[745,738,16,249,746,42],"3911367","tom9729",[131,748,18,386,132,42],70,[750,751,42,242,752,42],"3911821",71,"tomelders",[754,755,16,228,756,42],"3913747",72,"stcredzero",[154,758,47,238,155,42],73,[760,758,47,238,761,42],"3912769","johnpowell",[763,764,47,238,765,42],"3910460",74,"cleverjake",[767,768,16,228,769,42],"3913432",75,"thar2012",[771,772,42,242,773,42],"3913576",76,"tinyjoe",[775,776,18,386,777,42],"3912688",77,"tsunamifury",[779,780,16,434,781,42],"3912897",78,"taskstrike",[783,784,18,386,785,42],"3910883",79,"digitallimit",[787,784,16,406,788,42],"3910895","abrichr",[790,791],{"id":4,"t":12,"points":14,"comments":15},{"id":792,"t":793,"points":40,"comments":441},"3916630",1335910950,[795,800,805,810,814,819],{"id":796,"name":797,"points":798,"category":799},"3896931","iPG",290,"learning_science",{"id":801,"name":802,"points":803,"category":804},"3908844","cv",166,"productivity",{"id":806,"name":807,"points":808,"category":809},"3905318","Beatbar",147,"creative",{"id":811,"name":812,"points":813,"category":799},"3906373","Teach Yourself To Code",102,{"id":815,"name":816,"points":817,"category":818},"3896283","LiquidGraph",101,"ai",{"id":820,"name":821,"points":822,"category":20},"3901058","friggeri.net",95,false,"v2",{"id":826,"name":5,"line":6,"ai":823,"cat":20,"year":13,"points":14,"comments":15,"rec":27,"s":28,"top":18,"kw":827,"maker":11,"domain":10,"tier":19,"attempts":45,"strip":828,"url":9,"mix":829,"praise":78,"objection":102,"sub":21},3910304,[21,24,25,26],"5433205001552315335224525445321142134151",[30,31,32,33],1793990881022]