[{"data":1,"prerenderedAt":471},["ShallowReactive",2],{"project-46053076":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":36,"aspects":37,"strip":47,"post_text":50,"what":51,"said":79,"maker_in_thread":207,"shape":213,"grid":217,"attempts":432,"same_week":433,"maker_shows":41,"maker_hidden":463,"reader_version":464,"card":465},"46053076","Yandori News Flow","Real-time system that tracks how news spreads across 200k websites","title","Show HN: Real-time system that tracks how news spreads across 200k websites","https:\u002F\u002Fyandori.io\u002Fnews-flow\u002F","yandori.io","antiochIst",1764120436,2025,256,74,229,3837,6,"legend","data","news analytics","web_app",[24,25,26,27,28],"news propagation","story clustering","rss aggregation","embeddings","media analysis","debated",0.012,{"positive":32,"neutral":33,"mixed":34,"critical":35},11,17,4,12,44,{"idea":38,"execution":40,"design":43,"docs":44,"performance":46},{"positive":18,"critical":39},2,{"positive":41,"critical":42},1,8,{"positive":39,"critical":41},{"positive":45,"critical":45},0,{"positive":45,"critical":41},[41,45,45,41,48,45,49,41,48,49,48,48,48,48,48,49,48,48,48,48,48,48,41,41,48,41,48,41,41,49,48,41,41,48,45,49,49,45,45,48],3,5,"I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web.\n\nIt uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up.\n\nWould love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful.\n\nLive demo: https:\u002F\u002Fyandori.io\u002Fnews-flow\u002F",{"problem":52,"audience":58,"pricing":58,"motivation":59,"time_to_build":58,"stack":65,"openness":77,"stage":78,"team_size":77},{"value":53,"source":54,"evidence":55},"Shows who published a news story first and how it spread across outlets","maker",[56],{"id":57},"post",null,{"value":60,"source":54,"evidence":61},"Highlight original and powerful sources of news",[62],{"id":63,"by":11,"text":64},"46110584","Yea I feel you... Honestly I kinda just whipped this thing up in context of a larger project I'm working on.. so i have not given much thought to who it will serve. \"rooting out…",[66,73],{"value":67,"source":54,"evidence":68},"Snowflake Arctic embedding model",[69,70],{"id":57},{"id":71,"by":11,"text":72},"46110336","Currently I'm using Snowflake’s Arctic embedding model on the whole story not just the title, to cluster stories. There are still some issues, but its not as simple as looking at…",{"value":74,"source":54,"evidence":75},"HNSW for similarity search",[76],{"id":57},"unknown","beta",{"praise":80,"objections":93,"requests":132,"questions":166,"alternatives":192},[81],{"value":82,"source":83,"evidence":84},"Clean UI and interesting concept","commenter",[85,89],{"id":86,"by":87,"text":88},"46097082","A4ET8a8uTh0_v2","Good idea. Clean execution. Nice UI. I will repeat other poster's plea to make it open source. The information this provides is useful.",{"id":90,"by":91,"text":92},"46095856","hmokiguess","Cool idea! What I liked the most was the breakdown into categories like “breaking” and “trending” plus the number of sources. The view showing the flow with a play animation was…",[94,103,114,121],{"value":95,"source":54,"evidence":96},"Published dates from RSS feeds are often wrong, distorting first-publisher results",[97,100],{"id":98,"by":11,"text":99},"46110407","yea, what im currently doing is pretty simple check on published at date from the rss feed (with some small validation checks)... but its causing issues bc it can be wrong and…",{"id":101,"by":11,"text":102},"46110388","Yea not all major have rss feeds, but it seems like the majority still do. No translation yet. I think the biggest problem is im relying on published date from the news source…",{"value":104,"source":83,"evidence":105},"Includes spam and non-news sites",[106,110],{"id":107,"by":108,"text":109},"46095788","KomoD","I think the idea is interesting but it includes a lot of spam and non-news (e.g. archive.fo, .vn, .today, etc.)",{"id":111,"by":112,"text":113},"46096330","rvz","This looks a lot like a combination of spam and slop posed as \"breaking news\". > Opinion: Operation Holiday serves a critical need in our communities > Dhru Fusion WooCommerce…",{"value":115,"source":54,"evidence":116},"No translation for non-English articles",[117,120],{"id":118,"by":11,"text":119},"46110420","I'm basically throwing away non english articles for now... I'll pry get them in later, but I want to get english right first before trying to move to other languages... The…",{"id":101,"by":11,"text":102},{"value":122,"source":83,"evidence":123},"Wire-service republication is not handled, so attribution is wrong",[124,128],{"id":125,"by":126,"text":127},"46100589","Animats","Yes. For example, this story about Ukraine [1] is credited to WNYT as first, but the story itself credits the Associated Press. This problem is worth solving, because it's…",{"id":129,"by":130,"text":131},"46098064","65","I think you will need to filter out wire services like AP and Reuters, as I'm seeing stories that are mostly republished wire stories on random websites.",[133,141,152,159],{"value":134,"source":83,"evidence":135},"Open source the project",[136,140],{"id":137,"by":138,"text":139},"46096188","ewuhic","Without evaluating it thoroughly and judging just from description - I really hope this ends up open-sourced - will help drastically to many good-intent parties.",{"id":86,"by":87,"text":88},{"value":142,"source":83,"evidence":143},"Interactive graphs or network views",[144,148],{"id":145,"by":146,"text":147},"46097494","keepamovin","I feel a graph diagram (hub and spoke, showing \"data flow\") would be a useful alt view here. Cool website. As others note if this could tie in deep sources like FB, X, Reddit,…",{"id":149,"by":150,"text":151},"46098730","andai","This is related to my interests! Where'd you find all those RSS feeds? Have you done anything else with RSS feeds? :) Also agree with the others this definitely needs interactive…",{"value":153,"source":83,"evidence":154},"Include social media like Reddit and X",[155],{"id":156,"by":157,"text":158},"46096956","kburman","This is absolutely brilliant. If you integrate Reddit and Twitter\u002FX, you’d get a much more complete picture of how stories spread across the internet.",{"value":160,"source":83,"evidence":161},"Make headlines clickable and copyable",[162],{"id":163,"by":164,"text":165},"46102358","DivingForGold","It's useless to me because NONE of the titles are hotlinks, plus, you cannot even copy \u002F paste the titles to a browser. The creator has his script set to not allowing copying.",[167,178,185],{"value":168,"source":83,"evidence":169},"How were the sites and feeds selected?",[170,174],{"id":171,"by":172,"text":173},"46101058","elorant","More important for me is how you identify news sites, let alone 200k of them. Is there any online source that lists them? Or do you cherry pick them one by one?",{"id":175,"by":176,"text":177},"46096140","Havoc","That's really cool! Curious how you sourced the feeds? It seems to have a bias towards Indian\u002FSrilanka\u002FIran\u002FIndonesia\u002FTurkey etc - i.e. not the traditional western centric…",{"value":179,"source":83,"evidence":180},"What frontend and backend technologies are used?",[181],{"id":182,"by":183,"text":184},"46097234","actinium226","Very cool. I'm curious what frontend and backend technologies are used?",{"value":186,"source":83,"evidence":187},"How are time zones handled?",[188],{"id":189,"by":190,"text":191},"46096343","dmix","How do you handle time zone issues with the dates? I’ve been curious how much news starts from social media. So many news stories today are “someone said x on twitter”.",[193,200],{"value":194,"source":83,"evidence":195},"Newscord",[196],{"id":197,"by":198,"text":199},"46096384","pbiggar","See also Newscord, which does very similar work to analyze bias across news media: - https:\u002F\u002Fnewscord.org\u002Flatest - https:\u002F\u002Fwww.instagram.com\u002Fnewscord_org",{"value":201,"source":83,"evidence":202},"TARO academic news commonality tool",[203],{"id":204,"by":205,"text":206},"46096615","gioele","Kudos on releasing Yandori! We have been (low-keep) working on something similar (more from an academic point of view) for the past few years: This is the introductory article…",{"comments":208,"answered":18,"key":209},13,[210,211,212],{"id":71,"text":72},{"id":118,"text":119},{"id":98,"text":99},{"commenters":214,"max_depth":34,"maker_replies":208,"first_comment_mins":215,"lifespan_hours":216},57,7,232,[218,222,226,230,233,235,239,242,246,249,250,253,257,258,259,263,264,266,267,268,269,271,272,274,276,277,281,283,286,287,290,295,296,298,300,303,305,310,314,319,322,326,330,335,337,342,346,349,351,356,359,363,367,369,372,376,379,381,383,386,388,390,394,397,399,401,405,409,414,417,420,423,426,428],[219,45,41,220,221,45],"46097882","project\u002Fcritical\u002Fidea","Triphibian",[223,45,45,224,225,45],"46098858","commenter\u002Fneutral\u002Fidea","dkdcio",[227,45,45,228,229,45],"46099385","commenter\u002Fneutral\u002Fnone","cruffle_duffle",[231,45,45,224,232,45],"46100373","tbrownaw",[71,45,45,234,11,41],"maker\u002Fneutral\u002Fexecution",[236,41,41,237,238,45],"46096377","project\u002Fcritical\u002Fexecution","YmiYugy",[240,41,45,228,241,45],"46096482","badestrand",[243,41,45,244,245,45],"46097893","other\u002Fneutral\u002Fnone","Joel_Mckay",[247,41,48,248,150,45],"46098724","project\u002Fneutral\u002Fexecution",[118,41,45,234,11,41],[251,41,45,228,252,45],"46098765","fcarraldo",[254,41,49,255,256,45],"46098940","project\u002Fpositive\u002Fidea","dleeftink",[125,41,41,237,126,45],[98,41,45,234,11,41],[260,41,48,261,262,45],"46133181","maker\u002Fneutral\u002Fidea","justin66",[101,41,45,234,11,41],[145,39,49,265,146,45],"project\u002Fpositive\u002Fdesign",[137,48,49,255,138,45],[107,34,41,237,108,45],[156,49,49,255,157,45],[270,49,45,224,87,45],"46097092",[189,18,48,248,190,45],[273,18,45,234,11,41],"46110597",[275,18,48,234,190,45],"46156135",[171,215,48,248,172,45],[278,215,48,279,280,45],"46101282","project\u002Fneutral\u002Fdocs","rationably",[282,215,45,234,11,41],"46110469",[284,42,49,255,285,45],"46101082","cyrusradfar",[63,42,45,261,11,41],[149,288,48,289,150,45],9,"project\u002Fneutral\u002Fdesign",[291,292,48,293,294,45],"46096405",10,"project\u002Fmixed\u002Fdesign","codethief",[90,32,48,293,91,45],[204,35,45,297,205,45],"other\u002Fneutral\u002Fidea",[175,208,48,299,176,45],"project\u002Fmixed\u002Fexecution",[301,208,45,228,302,45],"46096425","supermatt",[304,208,45,234,11,41],"46110617",[306,307,48,308,309,45],"46096492",14,"project\u002Fneutral\u002Fidea","hk1337",[311,312,48,293,313,45],"46096764",15,"analogears",[315,316,48,317,318,45],"46099312",16,"project\u002Fneutral\u002Fperformance","ble",[320,33,48,308,321,45],"46097210","leobg",[323,324,45,297,325,45],"46100450",18,"maximator",[327,328,41,220,329,45],"46099727",19,"lmeyerov",[331,332,41,333,334,45],"46099502",20,"project\u002Fcritical\u002Fperformance","hbarka",[336,332,45,261,11,41],"46110655",[338,339,49,340,341,45],"46096107",21,"project\u002Fpositive\u002Fnone","juujian",[343,344,41,237,345,45],"46096081",22,"jMyles",[347,344,41,237,348,45],"46096310","guillem_lefait",[350,344,45,234,11,41],"46113487",[352,353,48,354,355,45],"46103984",23,"project\u002Fneutral\u002Fnone","rglynn",[163,357,41,358,164,45],24,"project\u002Fcritical\u002Fdesign",[360,361,48,308,362,45],"46095809",25,"psychoslave",[364,365,48,308,366,45],"46096681",26,"jacquesm",[129,368,41,237,130,45],27,[370,368,48,308,371,45],"46164358","wcallahan",[373,374,49,255,375,45],"46055955",28,"Oras",[182,377,48,378,183,45],29,"maker\u002Fneutral\u002Fnone",[197,380,45,244,198,45],30,[111,382,41,237,112,45],31,[384,382,45,228,385,45],"46096891","hopelite",[387,382,41,237,112,45],"46099731",[389,382,45,234,11,41],"46110686",[391,392,48,308,393,45],"46100938",32,"SilverElfin",[395,392,45,396,11,41],"46110706","maker\u002Fneutral\u002Fpricing",[398,392,45,308,11,41],"46110779",[86,400,49,265,87,45],33,[402,403,49,255,404,45],"46099057",34,"jauntywundrkind",[406,407,49,340,408,45],"46096606",35,"patrick4urcloud",[410,411,49,412,413,45],"46053121",36,"maker\u002Fpositive\u002Fexecution","masterphai",[415,411,45,228,416,45],"46096674","supriyo-biswas",[418,411,45,228,419,45],"46097415","yieldcrv",[421,411,45,228,422,45],"46099346","alchemist1e9",[424,411,45,228,425,45],"46100611","nextaccountic",[427,411,45,228,371,45],"46164294",[429,430,48,289,431,45],"46119379",37,"badmonster",[],[434,439,444,449,454,459],{"id":435,"name":436,"points":437,"category":438},"46036908","HN Simulator",538,"ai",{"id":440,"name":441,"points":442,"category":443},"46017175","Forty.News",443,"productivity",{"id":445,"name":446,"points":447,"category":448},"46048252","Flowglad",405,"web_saas",{"id":450,"name":451,"points":452,"category":453},"46051449","KiDoom",362,"games",{"id":455,"name":456,"points":457,"category":458},"46037031","exposedbydefault",275,"security_privacy",{"id":460,"name":461,"points":462,"category":438},"46006104","OCR Arena",216,false,"v2",{"id":466,"name":5,"line":6,"ai":463,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":467,"top":18,"kw":468,"maker":11,"domain":10,"tier":19,"attempts":45,"strip":469,"url":9,"mix":470,"praise":82,"objection":95,"sub":21},46053076,0.01,[24,25,26,27,28],"1001305135333335333333113131153113055003",[32,33,34,35],1794036686380]