[{"data":1,"prerenderedAt":340},["ShallowReactive",2],{"project-24846335":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":28,"sentiment":29,"stance_mix":30,"scored_comments":34,"aspects":35,"strip":42,"post_text":44,"what":45,"said":86,"maker_in_thread":183,"shape":193,"grid":196,"attempts":303,"same_week":304,"maker_shows":40,"maker_hidden":332,"reader_version":333,"card":334},"24846335","TidalWaves API","live, tokenized news metadata from around the world","title","Show HN: TidalWaves API – live, tokenized news metadata from around the world","https:\u002F\u002Ftidalwaves.io","tidalwaves.io","prohobo",1603275296,2020,124,45,511,3028,17,"notable","data","news metadata api","api",[24,25,26,27],"gdelt","news api","breaking news","news metadata","curious",-0.057,{"positive":31,"neutral":18,"mixed":32,"critical":33},3,1,4,25,{"execution":36,"design":38,"idea":39,"docs":41},{"positive":37,"critical":31},0,{"positive":37,"critical":37},{"positive":40,"critical":37},2,{"positive":37,"critical":37},[37,32,37,37,31,37,37,31,37,31,37,31,43,37,43,32,31,31,37,31,37,31,31,31,37,31,37,31,37,31,32,31,37,31,32,37,31,31,37,43],5,null,{"problem":46,"audience":56,"pricing":62,"motivation":66,"time_to_build":70,"stack":74,"openness":83,"stage":84,"team_size":85},{"value":47,"source":48,"evidence":49},"Makes raw GDELT news data usable for visualizations and data mining","maker",[50,53],{"id":51,"by":11,"text":52},"24846336","I spent 3 months building a data pipeline for parsing and transforming raw data from the GDELT project, as well as applying a machine learning model to find breaking news…",{"id":54,"by":11,"text":55},"24847778","Thanks! There are a lot of issues with GDELT data, but the things that come to mind recently are: - Missing keywords. Huge topics like \"brexit\" won't be found, so you need to…",{"value":57,"source":48,"evidence":58},"Amateur and solo developers building visualizations and personal apps",[59],{"id":60,"by":11,"text":61},"24847416","Thanks! While I agree GDELT doesn't have the kind of coverage some people may be looking for, I think it's the best source for world news insights. Oh nice, I actually saw…",{"value":63,"source":48,"evidence":64},"Tiered subscriptions on Rapid API; Tier 1 for marketing site, Tier 2 for historical data",[65],{"id":51,"by":11,"text":52},{"value":67,"source":48,"evidence":68},"Build a steady income to fund future projects",[69],{"id":51,"by":11,"text":52},{"value":71,"source":48,"evidence":72},"3 months",[73],{"id":51,"by":11,"text":52},[75,79],{"value":76,"source":48,"evidence":77},"GDELT data",[78],{"id":51,"by":11,"text":52},{"value":80,"source":48,"evidence":81},"Machine learning model for breaking news detection",[82],{"id":51,"by":11,"text":52},"unknown","launched","solo",{"praise":87,"objections":103,"requests":126,"questions":150,"alternatives":166},[88,96],{"value":89,"source":90,"evidence":91},"Map visualization looks good","commenter",[92],{"id":93,"by":94,"text":95},"24847196","artembugara","Nice project. I actually did pretty much the same a long time ago: an API around GDELT data. Your map looks fantastic, btw. The problem with GDELT is that they don't have that…",{"value":97,"source":90,"evidence":98},"Useful for various projects",[99],{"id":100,"by":101,"text":102},"24847568","Grimm1","Hey there, first off cool stuff I can see this being plenty useful for various projects. We're exploring GDELT data for our own needs and I was wondering if you wouldn't mind…",[104,112,119],{"value":105,"source":90,"evidence":106},"GDELT data is messy with duplicates and inconsistent tagging",[107,111],{"id":108,"by":109,"text":110},"24847179","arusahni","As someone who has built event pipelines from GDELT data, I'd advise folks to not start (a GDELT project) with high expectations. Not only are there plenty of duplicates, but…",{"id":54,"by":11,"text":55},{"value":113,"source":90,"evidence":114},"Duplicate breaking stories shown in the list",[115],{"id":116,"by":117,"text":118},"24846735","awestroke","There are duplicates on the list of 4 breaking stories. They have the exact same title, too.",{"value":120,"source":90,"evidence":121},"Rapid API hosts many low-quality APIs",[122],{"id":123,"by":124,"text":125},"24847671","OJFord","I've never heard of RapidAPI before, but it seems kind of scammy. As in, nice idea, bit just filled with low-quality spam APIs wrapping presumably free or cheaper services, not…",[127,137,144],{"value":128,"source":90,"evidence":129},"Publish the full list of news sources",[130,134],{"id":131,"by":132,"text":133},"24846975","wombatmobile","What are the 1000+ news sources? Is there a list of publications? e.g. New York Times, The Australian, Bangkok Post... ? I understand your data comes from GDELT. I'm new to that…",{"id":135,"by":132,"text":136},"24847079","Thanks for replying. I'm not sure what is useful yet - first of all I am trying to understand the scope of the data sources and the methodology for selections displayed in…",{"value":138,"source":90,"evidence":139},"Add JSON-LD\u002FRDF output for WikiData integration",[140],{"id":141,"by":142,"text":143},"24847253","abraxaz","Have you considered using JSON-LD\u002FRDF for this? It would make it easier to integrate with WikiData and data from other sources.",{"value":145,"source":48,"evidence":146},"Fuzzy title matching to merge duplicate stories",[147],{"id":148,"by":11,"text":149},"24846888","I'm definitely thinking of ways to improve it for long-term stories. You're right, fuzzy string matching would do wonders for that, thanks :)",[151,155,159],{"value":152,"source":90,"evidence":153},"What news sources are included?",[154],{"id":131,"by":132,"text":133},{"value":156,"source":90,"evidence":157},"How is trending popularity calculated?",[158],{"id":135,"by":132,"text":136},{"value":160,"source":90,"evidence":161},"What does the tone field mean?",[162],{"id":163,"by":164,"text":165},"24847232","vadiml","In the json data sample the site shows, what does 'tone' field means?",[167,172,179],{"value":168,"source":90,"evidence":169},"GDELT",[170,171],{"id":108,"by":109,"text":110},{"id":100,"by":101,"text":102},{"value":173,"source":90,"evidence":174},"ICEWS",[175],{"id":176,"by":177,"text":178},"24847476","nl","For some uses (if accuracy is more important than speed), ICEWS is available as periodic dumps on Dataverse. They use CAMEO for event encoding which - if imperfect - at least is…",{"value":180,"source":90,"evidence":181},"NewsCatcher API",[182],{"id":93,"by":94,"text":95},{"comments":18,"answered":184,"key":185},10,[186,187,190],{"id":51,"text":52},{"id":188,"text":189},"24847316","Agreed, it's very hit or miss in some situations. I'm hoping to keep evolving this to clean it up and eek out more salient information. I think GDELT is the best source, nothing…",{"id":191,"text":192},"24847522","I don't know what to say except: apologies. It is on there, and you can drag the map around horizontally, though that feature isn't very apparent currently.",{"commenters":194,"max_depth":43,"maker_replies":18,"first_comment_mins":37,"lifespan_hours":195},21,16,[197,199,201,204,206,209,211,213,217,220,222,223,225,229,231,232,235,239,241,242,244,247,249,251,253,257,259,263,265,268,269,270,272,276,278,280,282,283,285,288,290,294,296,298,301],[51,37,37,198,11,32],"project\u002Fneutral\u002Fnone",[108,32,32,200,109,37],"project\u002Fcritical\u002Fexecution",[202,32,37,203,94,37],"24847212","commenter\u002Fneutral\u002Fnone",[205,32,37,203,109,37],"24847308",[207,32,31,198,208,37],"24847282","chris_f",[188,32,37,210,11,32],"project\u002Fneutral\u002Fexecution",[212,32,37,203,109,37],"24847754",[214,40,31,215,216,37],"24847348","project\u002Fneutral\u002Fdesign","delineator",[218,40,31,215,219,37],"24847460","bmilleare",[191,40,37,221,11,32],"maker\u002Fneutral\u002Fdesign",[123,31,31,198,124,37],[224,31,37,198,11,32],"24847724",[226,31,31,227,228,37],"24851145","maker\u002Fneutral\u002Fnone","keithwhor",[100,33,43,230,101,37],"project\u002Fpositive\u002Fidea",[54,33,37,210,11,32],[233,33,43,234,101,37],"24848104","maker\u002Fpositive\u002Fnone",[236,33,32,237,238,37],"24849715","maker\u002Fcritical\u002Fnone","panarky",[240,33,37,227,11,32],"24850421",[176,43,31,198,177,37],[131,243,31,198,132,37],6,[245,243,37,246,11,32],"24847013","project\u002Fneutral\u002Fdocs",[135,243,31,248,132,37],"project\u002Fneutral\u002Fidea",[250,243,37,198,11,32],"24847275",[252,243,31,246,132,37],"24847540",[254,255,31,246,256,37],"24847329",7,"TruffleLabs",[258,255,37,246,11,32],"24847484",[260,261,31,198,262,37],"24848670",8,"jszymborski",[264,261,37,198,11,32],"24848758",[93,266,31,267,94,37],9,"project\u002Fmixed\u002Fdesign",[60,266,37,248,11,32],[141,184,31,246,142,37],[271,184,37,246,11,32],"24851529",[273,274,31,248,275,37],"24851642",11,"op03",[116,277,32,200,117,37],12,[279,277,37,210,11,32],"24846771",[281,277,31,210,117,37],"24846848",[148,277,37,210,11,32],[284,277,31,210,208,37],"24847046",[286,277,32,200,287,37],"24846920","petre",[289,277,37,210,11,32],"24846965",[291,292,31,215,293,37],"24854327",13,"bashallah",[163,295,31,246,164,37],14,[297,295,37,246,11,32],"24847625",[299,295,43,230,300,37],"24848250","lawrenceong",[302,295,37,198,11,32],"24848721",[],[305,310,315,320,324,328],{"id":306,"name":307,"points":308,"category":309},"24834636","Arturo",324,"languages",{"id":311,"name":312,"points":313,"category":314},"24842306","Bunkerized-Nginx",221,"infrastructure",{"id":316,"name":317,"points":318,"category":319},"24835219","Formito Favicon Generator",199,"dev_tools",{"id":321,"name":322,"points":323,"category":319},"24833801","ConsoleChat",148,{"id":325,"name":326,"points":327,"category":314},"24829768","Turing Pi 2",109,{"id":329,"name":330,"points":331,"category":319},"24790500","WebCatalog",64,false,"v2",{"id":335,"name":5,"line":6,"ai":332,"cat":20,"year":13,"points":14,"comments":15,"rec":28,"s":336,"top":18,"kw":337,"maker":11,"domain":10,"tier":19,"attempts":37,"strip":338,"url":9,"mix":339,"praise":89,"objection":105,"sub":21},24846335,-0.06,[24,25,26,27],"0100300303035051330303330303031303103305",[31,18,32,33],1794036597477]