[{"data":1,"prerenderedAt":659},["ShallowReactive",2],{"project-36009774":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":36,"aspects":37,"strip":43,"post_text":45,"what":46,"said":68,"maker_in_thread":148,"shape":156,"grid":161,"attempts":623,"same_week":624,"maker_shows":39,"maker_hidden":651,"reader_version":652,"card":653},"36009774","YouTube Full Text Search","Search all of a channel from the commandline","title","Show HN: YouTube Full Text Search – Search all of a channel from the commandline","https:\u002F\u002Fgithub.com\u002FNotJoeMartinez\u002Fyt-fts","github.com","notjoemartinez",1684563504,2023,540,165,51,3109,2,"legend","dev_tools","command line search tool","cli",[24,25,26,27,28],"youtube subtitles","full text search","sqlite","yt-dlp","command line","curious",0.154,{"positive":32,"neutral":33,"mixed":34,"critical":35},11,26,1,4,42,{"execution":38,"idea":40,"design":41},{"positive":39,"critical":39},3,{"positive":35,"critical":34},{"positive":42,"critical":42},0,[42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,42,35,39,39,42,35,39,18,44,35,39,35,34,44,42,42,39,44,39,39,44],5,"yt-fts is a simple python script that uses yt-dlp to scrape all of a youtube channels subtitles and load them into an sqlite database that is searchable from the command line. It allows you to query a channel for specific key word or phrase and will generate time stamped youtube urls to the video containing the keyword.",{"problem":47,"audience":53,"pricing":53,"motivation":53,"time_to_build":53,"stack":54,"openness":66,"stage":67,"team_size":67},{"value":48,"source":49,"evidence":50},"Searching all of a YouTube channel's spoken content for a keyword or phrase","maker",[51],{"id":52},"post",null,[55,59,62],{"value":56,"source":49,"evidence":57},"Python",[58],{"id":52},{"value":27,"source":49,"evidence":60},[61],{"id":52},{"value":63,"source":49,"evidence":64},"SQLite",[65],{"id":52},"open_source","unknown",{"praise":69,"objections":86,"requests":105,"questions":128,"alternatives":136},[70],{"value":71,"source":72,"evidence":73},"Useful idea for searching channel transcripts","commenter",[74,78,82],{"id":75,"by":76,"text":77},"36010453","pknerd","Loved the idea, yet to try it out. I would definitely download all videos of Lex and run some text analyzer\u002Ftext cloud generator to learn about things being discussed",{"id":79,"by":80,"text":81},"36014859","bsnnkv","This is great! I had made something like this for my own use, but it was way more complicated. It took a user account, downloaded all the liked videos, ran it through some model…",{"id":83,"by":84,"text":85},"36009967","foderking","nice",[87,94],{"value":88,"source":72,"evidence":89},"Uses scraping rather than the YouTube API, with quota concerns",[90],{"id":91,"by":92,"text":93},"36012377","harlanji","I hate being the poo pooer who says that subtitles are available via the API and wish the tool went that route. I'm all for stuff being archivable with tools like youtube-dl, but…",{"value":95,"source":72,"evidence":96},"Uses LIKE queries rather than full-text search",[97,101],{"id":98,"by":99,"text":100},"36010804","1equalsequals1","Perhaps I'm wrong but how is this full text search? It's just using the LIKE operator",{"id":102,"by":103,"text":104},"36018153","simonw","It looks like you're running searches using LIKE: https:\u002F\u002Fgithub.com\u002FNotJoeMartinez\u002Fyt-fts\u002Fblob\u002F050981c0519a966593d2e2405bf2116997a00909\u002Fdb_scripts.py#L81 SQLite has a really…",[106,121],{"value":107,"source":72,"evidence":108},"Semantic search via vector database or LLM",[109,113,117],{"id":110,"by":111,"text":112},"36010288","monkeydust","Nice work. You could encode the text, load this into a vector database and allow semantic search.",{"id":114,"by":115,"text":116},"36010705","liampulles","Put the subs into a vector db instead and enable semantic search. :)",{"id":118,"by":119,"text":120},"36013804","teelelbrit","Why not fold this into an LLM interface?",{"value":122,"source":72,"evidence":123},"Search comments as well as subtitles",[124],{"id":125,"by":126,"text":127},"36010474","rmdes","Wondering if this could be expanded to also search for comments",[129],{"value":130,"source":72,"evidence":131},"Does it rely on an API key?",[132],{"id":133,"by":134,"text":135},"36014650","dredmorbius","Does this rely on an API key? There have been earlier tools which permitted command-line \u002F terminal access to Youtube, one of the best being mps-youtube:…",[137,144],{"value":138,"source":72,"evidence":139},"Tube Archivist",[140],{"id":141,"by":142,"text":143},"36013461","progman32","Another avenue for this is to use Tube Archivist, which takes the approach of locally mirroring videos and serving them up in a web interface, complete with comments, subtitles,…",{"value":145,"source":72,"evidence":146},"mps-youtube",[147],{"id":133,"by":134,"text":135},{"comments":18,"answered":42,"key":149},[150,153],{"id":151,"text":152},"36147588","Thank you! I was able to integrate this into the project[1]. I'm also looking into using your openai-to-sqlite[2] library for semantic search.…",{"id":154,"text":155},"36147518","> yt-fts search \"love\" --channel \"Lex Fridman\" | grep \"love\" | wc -l > 7060",{"commenters":157,"max_depth":158,"maker_replies":18,"first_comment_mins":159,"lifespan_hours":160},120,8,47,332,[162,166,169,172,175,177,180,183,186,189,192,195,198,200,203,206,209,212,215,218,221,224,227,230,233,236,239,242,245,248,251,254,257,259,262,265,268,271,274,277,279,281,283,285,288,291,294,296,298,300,303,306,309,311,313,316,318,320,322,325,327,329,331,334,336,339,342,345,348,351,354,358,361,364,367,370,373,376,379,381,383,385,388,391,393,397,401,403,406,409,412,416,419,422,425,426,429,431,434,437,439,442,444,447,449,452,454,457,460,463,465,468,472,475,478,481,482,484,488,493,495,496,499,501,506,509,511,513,515,519,523,525,529,533,535,538,540,543,546,549,552,554,557,560,562,565,569,571,573,575,579,583,586,589,591,593,596,599,601,604,606,610,612,615,617,621],[163,42,42,164,165,42],"36009983","other\u002Fneutral\u002Fnone","derefr",[167,42,42,164,168,42],"36010052","stingraycharles",[170,42,42,164,171,42],"36010226","methou",[173,42,42,164,174,42],"36010060","mrazomor",[176,42,42,164,165,42],"36010127",[178,42,42,164,179,42],"36010338","userbinator",[181,42,42,164,182,42],"36010098","choppaface",[184,42,42,164,185,42],"36010223","hysan",[187,42,42,188,165,42],"36010817","commenter\u002Fneutral\u002Fnone",[190,42,42,188,191,42],"36010882","dmbche",[193,42,42,188,194,42],"36010951","belter",[196,42,42,188,197,42],"36011307","refulgentis",[199,42,42,188,194,42],"36011546",[201,42,42,164,202,42],"36012592","tiffanyg",[204,42,42,164,205,42],"36016645","mos_basik",[207,42,42,188,208,42],"36011290","sokoloff",[210,42,42,188,211,42],"36011304","HardlyCurious",[213,42,42,188,214,42],"36011323","lettergram",[216,42,42,188,217,42],"36012173","brookst",[219,42,42,188,220,42],"36015322","xp84",[222,42,42,188,223,42],"36015349","fatneckbeard",[225,42,42,188,226,42],"36012565","mistermann",[228,42,42,188,229,42],"36014146","justsomehnguy",[231,42,42,188,232,42],"36016087","gverrilla",[234,42,42,164,235,42],"36011381","hackernewds",[237,42,42,164,238,42],"36011481","ekianjo",[240,42,42,164,241,42],"36011630","danols",[243,42,42,164,244,42],"36011658","tourmalinetaco",[246,42,42,188,247,42],"36011969","reaperducer",[249,42,42,188,250,42],"36012578","j33zusjuice",[252,42,42,188,253,42],"36013866","roncesvalles",[255,42,42,188,256,42],"36010277","Pazzaz",[258,42,42,188,165,42],"36010835",[260,42,42,188,261,42],"36010339","sharess",[263,42,42,188,264,42],"36012055","flenserboy",[266,42,42,188,267,42],"36010355","ranting-moth",[269,42,42,188,270,42],"36010410","gniv",[272,42,42,164,273,42],"36010994","davidy123",[275,42,42,188,276,42],"36011157","ramraj07",[278,42,42,188,270,42],"36011896",[280,42,42,188,276,42],"36018186",[282,42,42,188,253,42],"36013929",[284,42,42,188,276,42],"36017331",[286,42,42,164,287,42],"36010560","dizhn",[289,42,42,164,290,42],"36010742","Jakob",[292,42,42,164,293,42],"36010948","tambourine_man",[295,42,42,164,270,42],"36010841",[297,42,42,164,287,42],"36020916",[299,42,42,164,270,42],"36072261",[301,42,42,164,302,42],"36010584","yosito",[304,42,42,164,305,42],"36010727","MildlySerious",[307,42,42,164,308,42],"36011078","pmoriarty",[310,42,42,164,214,42],"36011303",[312,42,42,164,235,42],"36011376",[314,42,42,164,315,42],"36011528","dividedbyzero",[317,42,42,164,214,42],"36011595",[319,42,42,164,214,42],"36011570",[321,42,42,164,244,42],"36011628",[323,42,42,164,324,42],"36012204","euix",[326,42,42,164,214,42],"36012934",[328,42,42,188,244,42],"36011598",[330,42,42,188,238,42],"36011476",[332,42,42,188,333,42],"36011844","guerrilla",[335,42,42,164,247,42],"36011962",[337,42,42,164,338,42],"36012066","jameshart",[340,42,42,164,341,42],"36012134","jimmySixDOF",[343,42,42,164,344,42],"36012473","andai",[346,42,42,164,347,42],"36012509","rasz",[349,42,42,164,350,42],"36012554","zip1",[352,42,42,188,353,42],"36012630","2020aj",[355,42,42,356,357,42],"36012981","other\u002Fneutral\u002Fidea","dingledork69",[359,42,42,164,360,42],"36013429","StrangeATractor",[362,42,42,188,363,42],"36014798","zo1",[365,42,42,164,366,42],"36015542","whitemary",[368,42,42,188,369,42],"36020870","bob_theslob646",[371,42,42,164,372,42],"36014101","drumhead",[374,42,42,188,375,42],"36014470","ttctciyf",[377,42,42,164,378,42],"36014534","freedomben",[380,42,42,164,134,42],"36014673",[382,42,42,164,223,42],"36015324",[384,42,42,164,366,42],"36015533",[386,42,42,188,387,42],"36015705","crazygringo",[389,42,42,188,390,42],"36016945","harshreality",[392,42,42,188,387,42],"36017612",[394,34,44,395,396,42],"36010175","project\u002Fpositive\u002Fexecution","gorgoiler",[398,34,39,399,400,42],"36011556","project\u002Fneutral\u002Fexecution","Boltgolt",[402,34,39,399,396,42],"36012041",[404,34,39,399,405,42],"36012598","Scaevolus",[407,34,39,399,408,42],"36014975","eternauta3k",[410,34,39,399,411,42],"36018130","lennxa",[413,18,39,414,415,42],"36010481","project\u002Fneutral\u002Fidea","nomilk",[417,18,42,188,418,42],"36011028","hnarn",[420,18,42,164,421,42],"36011908","moritonal",[423,18,39,414,424,42],"36012132","prometheon1",[102,39,39,399,103,42],[427,39,42,188,428,42],"36020851","lfconsult",[151,39,42,430,11,34],"maker\u002Fpositive\u002Fnone",[432,35,42,164,433,42],"36010801","lopatin",[435,35,42,164,436,42],"36031859","noman-land",[154,35,42,438,11,34],"project\u002Fneutral\u002Fnone",[440,35,44,441,433,42],"36159307","project\u002Fpositive\u002Fnone",[443,35,44,441,436,42],"36171883",[445,35,34,446,436,42],"36172294","project\u002Fcritical\u002Fexecution",[448,35,39,438,436,42],"36173174",[450,44,42,164,451,42],"36010853","expertentipp",[453,44,42,164,235,42],"36011365",[455,44,42,164,456,42],"36011925","galleywest200",[458,44,42,164,459,42],"36016239","smcleod",[461,44,42,164,462,42],"36011967","lawrencehook",[91,464,34,446,92,42],6,[466,464,39,399,467,42],"36018142","tonto",[469,470,39,414,471,42],"36010240",7,"ggerganov",[473,470,42,164,474,42],"36011023","cced",[476,470,42,188,477,42],"36015957","gukoff",[479,470,42,188,480,42],"36017525","zdwolfe",[79,158,44,395,80,42],[483,158,42,188,369,42],"36020925",[485,486,39,414,487,42],"36010063",9,"dpflan",[489,490,44,491,492,42],"36018600",10,"project\u002Fpositive\u002Fidea","vram22",[494,490,39,414,492,42],"36018613",[133,32,39,438,134,42],[497,32,39,438,498,42],"36015816","philsnow",[500,32,42,188,134,42],"36016175",[502,503,39,504,505,42],"36010401",12,"project\u002Fmixed\u002Fexecution","xurukefi",[507,503,39,399,508,42],"36010496","LaputanMachine",[510,503,44,395,428,42],"36011162",[512,503,39,399,428,42],"36020879",[514,503,42,164,459,42],"36016249",[516,517,42,164,518,42],"36014028",13,"almog",[520,521,34,522,369,42],"36020909",14,"project\u002Fcritical\u002Fidea",[141,524,39,438,142,42],15,[526,527,42,164,528,42],"36028278",16,"theo_champion",[530,527,39,531,532,42],"36028754","project\u002Fneutral\u002Fdesign","harryvederci",[110,534,44,491,111,42],17,[536,534,42,164,537,42],"36010314","Reflecticon",[539,534,42,188,111,42],"36010391",[541,534,42,164,542,42],"36010922","pyinstallwoes",[544,534,42,164,545,42],"36012299","rahimnathwani",[547,534,42,548,76,42],"36010464","commenter\u002Fneutral\u002Fidea",[550,534,42,548,551,42],"36010771","bigzyg33k",[553,534,42,164,474,42],"36011080",[555,534,42,164,556,42],"36012002","djhn",[558,534,42,164,559,42],"36012207","password4321",[561,534,42,164,545,42],"36012316",[563,534,42,164,564,42],"36018513","fzliu",[566,567,34,446,568,42],"36010878",18,"DyslexicAtheist",[570,567,39,399,428,42],"36011369",[572,567,39,399,428,42],"36020896",[75,574,44,491,76,42],19,[576,577,42,164,578,42],"36047546",20,"theptrk",[580,581,44,491,582,42],"36010210",21,"lessname",[584,581,42,164,585,42],"36010318","warangal",[587,581,42,164,588,42],"36011150","aabbcc1241",[590,581,42,164,341,42],"36019784",[98,592,39,399,99,42],22,[594,592,42,188,595,42],"36010823","dexterdog",[597,592,42,188,598,42],"36010840","Hendrikto",[114,600,39,414,115,42],23,[602,600,42,188,603,42],"36010949","jcq3",[605,600,42,548,474,42],"36011030",[607,608,39,414,609,42],"36010125",24,"ivan2kh",[125,611,39,414,126,42],25,[613,33,44,430,614,42],"36010816","mitesh07",[118,616,39,414,119,42],27,[618,619,42,164,620,42],"36010363",28,"BoBoiBoy",[83,622,44,441,84,42],29,[],[625,630,635,639,643,647],{"id":626,"name":627,"points":628,"category":629},"36064639","Pixian",383,"ai",{"id":631,"name":632,"points":633,"category":634},"36047143","Open sourcing Harmonic",305,"consumer_social",{"id":636,"name":637,"points":638,"category":20},"36020717","Trogon",248,{"id":640,"name":641,"points":642,"category":20},"36020001","SpaceBadgers",199,{"id":644,"name":645,"points":646,"category":629},"36037419","Blotter",166,{"id":648,"name":649,"points":650,"category":629},"36038815","DB-GPT",156,false,"v2",{"id":654,"name":5,"line":6,"ai":651,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":655,"top":18,"kw":656,"maker":11,"domain":10,"tier":19,"attempts":42,"strip":657,"url":9,"mix":658,"praise":71,"objection":88,"sub":21},36009774,0.15,[24,25,26,27,28],"0000000000000000000043304325434150035335",[32,33,34,35],1794036635838]