[{"data":1,"prerenderedAt":494},["ShallowReactive",2],{"project-34881286":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":33,"aspects":34,"strip":44,"post_text":47,"what":48,"said":90,"maker_in_thread":169,"shape":182,"grid":187,"attempts":456,"same_week":457,"maker_shows":312,"maker_hidden":486,"reader_version":487,"card":488},"34881286","Yobulk","Open-source CSV importer powered by GPT3","title","Show HN: Yobulk – Open-source CSV importer powered by GPT3","https:\u002F\u002Fgithub.com\u002Fyobulkdev\u002Fyobulkdev","github.com","yosai",1676988343,2023,233,109,224,3109,8,"notable","data","csv importer","web_app",[21,24,25,26],"csv validation","data import","open source csv","debated",-0.097,{"positive":18,"neutral":30,"mixed":31,"critical":32},14,1,9,32,{"idea":35,"pricing":38,"privacy":40,"docs":41,"execution":42,"performance":43},{"positive":36,"critical":37},4,7,{"positive":39,"critical":39},0,{"positive":39,"critical":39},{"positive":39,"critical":31},{"positive":39,"critical":39},{"positive":31,"critical":39},[45,39,39,39,39,45,46,45,39,39,39,39,31,39,39,45,39,31,46,46,46,46,39,46,39,46,39,39,46,39,31,31,45,31,39,46,31,31,45,46],5,3,null,{"problem":49,"audience":56,"pricing":47,"motivation":60,"time_to_build":47,"stack":64,"openness":87,"stage":88,"team_size":89},{"value":50,"source":51,"evidence":52},"Cleaning and validating messy CSV files from customers before import","maker",[53],{"id":54,"by":11,"text":55},"34881354","Hey Everybody, We are really excited to open source YoBulk today. YoBulk is an open source CSV importer for any SaaS application - It's a free alternative to…",{"value":57,"source":51,"evidence":58},"Developers, product managers, customer success teams and marketers handling CSV uploads",[59],{"id":54,"by":11,"text":55},{"value":61,"source":51,"evidence":62},"Automate CSV importing pain from previous startups' billboard and location data work",[63],{"id":54,"by":11,"text":55},[65,74,81],{"value":66,"source":51,"evidence":67},"OpenAI API",[68,71],{"id":69,"by":11,"text":70},"34881687","@dstala thanks for exploring YoBulk.Under the hood,YoBulk uses Open AI apis which takes the uploaded CSV column name and template column as an input and gives accurate…",{"id":72,"by":11,"text":73},"34882159","We are using OpenAI to only to create schema, column matching and Regex generation.No CSV data are sent to open AI..",{"value":75,"source":51,"evidence":76},"MongoDB",[77,78],{"id":54,"by":11,"text":55},{"id":79,"by":11,"text":80},"34891457","icelancer,Right now YoBulk is flattening the CSV to JSON with key-value document DB format and storing in MongoDB.You can use GPT3 to create mongo queries to fetch the data.We…",{"value":82,"source":51,"evidence":83},"Apache Arrow",[84],{"id":85,"by":11,"text":86},"34884302","@data_ders We realized that more than 70% of business data is shared in CSV and Excel formats, and only a small percentage use API integrations for data exchange..So CSV is here…","open_source","launched","unknown",{"praise":91,"objections":104,"requests":130,"questions":145,"alternatives":157},[92],{"value":93,"source":94,"evidence":95},"Good use case and promising concept","commenter",[96,100],{"id":97,"by":98,"text":99},"34883676","data_ders","wait… if importing malformed csvs gets automated that’s like half of a data professional’s job gone in a poof of smoke \u002Fs. jk -- great use case so often w\u002F pandas I’d: 1. “yeet”…",{"id":101,"by":102,"text":103},"34881533","yarapavan","This looks good and promising! Congrats and best wishes, yosai!!",[105,112,123],{"value":106,"source":94,"evidence":107},"Open-source tool depends on closed-source OpenAI API",[108],{"id":109,"by":110,"text":111},"34888779","dontcontactme","\"Open source tool powered by closed source API\" Is it really open source then?",{"value":113,"source":94,"evidence":114},"GPT output may be wrong and risky for data correctness",[115,119],{"id":116,"by":117,"text":118},"34884166","bcrl","This strikes me as an idea as bad as the Xerox document scanner that implemented a compression algorithm that changed digits. It'll be really fun debugging when something…",{"id":120,"by":121,"text":122},"34885021","WhiteNoiz3","When I read the headline I thought this would take a few rows of your CSV file and generate the schema from that using AI. Seems like you still need to manually describe the…",{"value":124,"source":94,"evidence":125},"Privacy concerns about sending customer data to third parties",[126],{"id":127,"by":128,"text":129},"34881955","jimlongton","Does this send all the data to a third party? What if it contains personal information?",[131,138],{"value":132,"source":94,"evidence":133},"Better documentation and examples of use versus Flatfile",[134],{"id":135,"by":136,"text":137},"34890386","RileyJames","I’m looking for a solution to this problem at the moment. Of course I could DIY, but I’m more attracted to a solution like flat file or YoBulk, rather than reinvent the wheel.…",{"value":139,"source":51,"evidence":140},"API access to query data",[141,142],{"id":79,"by":11,"text":80},{"id":143,"by":11,"text":144},"34882231","@anoonmoose we have an internal pipeline which streams the monogoDB data to any CSV or any webhook url path.it's a export pipeline which streams the processed data to CSVs.We…",[146,153],{"value":147,"source":94,"evidence":148},"Does it handle large files",[149],{"id":150,"by":151,"text":152},"34881601","cjtechie","This is what exactly I was looking for. Will it help me to run big files and cleanse?",{"value":154,"source":94,"evidence":155},"Does it send data to third parties",[156],{"id":127,"by":128,"text":129},[158,163],{"value":159,"source":94,"evidence":160},"Flatfile",[161,162],{"id":135,"by":136,"text":137},{"id":85,"by":11,"text":86},{"value":164,"source":51,"evidence":165},"OneSchema, Osmos, Dropbase",[166],{"id":167,"by":11,"text":168},"34888482","some of the companies in this space>> https:\u002F\u002Fflatfile.com\u002F,https:\u002F\u002Fwww.oneschema.co\u002F,https:\u002F\u002Fwww.osmos.io\u002F,https:\u002F\u002Fwww.dropbase.io\u002F",{"comments":170,"answered":171,"key":172},35,12,[173,176,179],{"id":174,"text":175},"34884420","@nerdponx You are spot on..",{"id":177,"text":178},"34884380","@sgerenser Yes CSV is everywhere..YoBulk is smartly positioning itself for the data donor\u002Fprovider or customer..It is the end customer or data provider who bite the bullet and do…",{"id":180,"text":181},"34892842","yes textninja.YoBulk's vision is to automate the first mile data onboarding and cleaning through AI so that Data scientists are free from doing any mundane task of data cleaning.",{"commenters":183,"max_depth":184,"maker_replies":170,"first_comment_mins":185,"lifespan_hours":186},52,10,6,73,[188,190,194,198,200,203,206,208,211,213,216,219,220,221,224,227,230,234,236,238,240,243,245,248,250,252,255,257,260,262,265,268,271,274,278,281,283,286,289,292,294,297,299,302,303,306,309,311,313,315,317,319,322,325,327,330,332,333,335,337,339,342,344,347,350,352,355,358,360,363,366,368,371,373,375,378,381,383,385,387,390,391,393,395,398,400,404,406,409,411,412,415,418,420,422,424,427,428,431,432,433,435,439,441,443,445,448,450,452],[97,39,45,189,98,39],"maker\u002Fpositive\u002Fidea",[191,39,39,192,193,39],"34883864","other\u002Fneutral\u002Fidea","sgerenser",[195,39,39,196,197,39],"34884075","other\u002Fneutral\u002Fnone","nerdponx",[174,39,39,199,11,31],"commenter\u002Fneutral\u002Fnone",[201,39,39,196,202,39],"34884657","aforwardslash",[204,39,39,192,205,39],"34885227","refulgentis",[207,39,39,192,197,39],"34885575",[209,39,39,196,210,39],"34885547","Fnoord",[177,39,39,212,11,31],"project\u002Fneutral\u002Fidea",[214,39,39,196,215,39],"34884031","boringg",[217,39,39,196,218,39],"34892497","textninja",[180,39,39,212,11,31],[85,39,39,212,11,31],[222,39,39,196,223,39],"34885346","chaps",[225,39,39,226,11,31],"34886421","project\u002Fneutral\u002Fexecution",[228,39,45,229,223,39],"34891518","project\u002Fpositive\u002Fidea",[231,39,46,232,233,39],"34891902","project\u002Fneutral\u002Fpricing","anonymouse008",[235,39,46,212,223,39],"34891943",[237,39,39,196,233,39],"34899876",[239,39,39,226,11,31],"34901106",[241,39,45,242,233,39],"34925146","maker\u002Fpositive\u002Fnone",[244,39,39,212,11,31],"34892206",[246,39,39,196,247,39],"34885745","faebi",[249,39,39,196,205,39],"34885158",[251,39,39,196,223,39],"34885265",[253,39,39,196,254,39],"34886023","wrycoder",[256,39,39,196,223,39],"34886265",[258,39,39,196,259,39],"34885950","recursive",[261,39,39,212,11,31],"34886341",[263,39,39,196,264,39],"34886789","ed_elliott_asc",[266,39,39,196,267,39],"34888394","groestl",[269,39,39,196,270,39],"34888522","thedudeabides5",[272,39,39,196,273,39],"34886376","silent_cal",[275,39,31,276,277,39],"34888887","project\u002Fcritical\u002Fidea","anothernewdude",[279,31,46,212,280,39],"34882152","anoonmoose",[282,31,39,196,197,39],"34882201",[284,31,39,196,285,39],"34883418","IanCal",[287,31,39,196,288,39],"34883881","carterschonwald",[290,31,39,196,291,39],"34882227","0live",[293,31,39,212,11,31],"34882267",[295,31,45,229,296,39],"34885504","aarondia",[298,31,39,212,11,31],"34886645",[300,31,45,301,280,39],"34882579","project\u002Fpositive\u002Fnone",[143,31,39,226,11,31],[304,31,39,196,305,39],"34883579","breck",[307,31,39,196,308,39],"34884354","a_subsystem",[310,31,39,196,296,39],"34885374",[116,312,31,276,117,39],2,[314,312,39,212,11,31],"34884547",[127,46,46,316,128,39],"project\u002Fneutral\u002Fprivacy",[318,46,39,316,11,31],"34882089",[320,46,46,316,321,39],"34882124","counttheforks",[323,46,46,316,324,39],"34882150","wstuartcl",[326,46,39,212,11,31],"34882847",[328,46,46,329,128,39],"34883851","project\u002Fneutral\u002Fdocs",[331,46,39,329,11,31],"34885358",[72,46,39,316,11,31],[334,46,46,226,197,39],"34882226",[336,46,39,226,11,31],"34882755",[338,46,39,196,197,39],"34883893",[340,46,39,341,11,31],"34884654","project\u002Fpositive\u002Fexecution",[343,46,39,199,197,39],"34884761",[345,46,39,346,11,31],"34889307","maker\u002Fneutral\u002Fnone",[348,46,46,316,349,39],"34883805","justeleblanc",[351,46,39,212,11,31],"34884721",[353,46,39,196,354,39],"34885092","dang",[356,46,39,196,357,39],"34885629","cdolan",[359,46,39,196,354,39],"34886575",[361,46,46,212,362,39],"34882180","l33t233372",[364,46,39,196,365,39],"34882773","olalonde",[367,46,39,199,362,39],"34883376",[369,46,39,199,370,39],"34884103","coolspot",[372,46,39,196,362,39],"34884422",[374,46,39,199,11,31],"34882788",[376,36,39,196,377,39],"34886909","PaulHoule",[379,36,39,196,380,39],"34888463","Der_Einzige",[382,36,39,196,377,39],"34888754",[384,36,39,212,11,31],"34889661",[135,45,46,386,136,39],"project\u002Fmixed\u002Fdocs",[388,45,39,389,11,31],"34890598","maker\u002Fneutral\u002Fdocs",[54,185,39,229,11,31],[392,185,46,226,197,39],"34882029",[394,185,39,226,11,31],"34885524",[396,185,31,276,397,39],"34882810","hermitcrab",[399,185,39,199,11,31],"34885239",[401,185,31,402,403,39],"34883994","project\u002Fcritical\u002Fdocs","Mystery-Machine",[405,185,39,329,11,31],"34885315",[407,185,45,229,408,39],"34887146","hattermat",[167,185,39,410,11,31],"project\u002Fneutral\u002Fnone",[120,37,31,276,121,39],[413,37,31,276,414,39],"34885324","iLoveOncall",[416,37,39,199,417,39],"34887944","blowski",[419,37,39,199,414,39],"34888990",[421,37,39,199,121,39],"34895734",[423,37,39,212,11,31],"34886785",[425,18,46,212,426,39],"34891047","icelancer",[79,18,39,212,11,31],[429,32,46,212,430,39],"34881639","dstala",[69,32,39,212,11,31],[109,184,31,276,110,39],[434,184,39,199,11,31],"34889179",[436,437,31,276,438,39],"34890196",11,"ddgflorida",[440,437,39,212,11,31],"34890722",[150,171,46,442,151,39],"project\u002Fneutral\u002Fperformance",[444,171,39,442,11,31],"34881635",[446,171,45,447,151,39],"34881820","project\u002Fpositive\u002Fperformance",[101,449,45,301,102,39],13,[451,449,39,346,11,31],"34881697",[453,30,31,454,455,39],"34891069","project\u002Fcritical\u002Fnone","nektro",[],[458,463,468,472,477,481],{"id":459,"name":460,"points":461,"category":462},"34869244","PyGWalker",712,"dev_tools",{"id":464,"name":465,"points":466,"category":467},"34897773","AskHN",612,"ai",{"id":469,"name":470,"points":471,"category":462},"34897645","highlight.io",408,{"id":473,"name":474,"points":475,"category":476},"34826085","Basement Community",373,"consumer_social",{"id":478,"name":479,"points":480,"category":462},"34848583","Noya",285,{"id":482,"name":483,"points":484,"category":485},"34901481","Jotte",212,"creative",false,"v2",{"id":489,"name":5,"line":6,"ai":486,"cat":20,"year":13,"points":14,"comments":15,"rec":27,"s":490,"top":18,"kw":491,"maker":11,"domain":10,"tier":19,"attempts":39,"strip":492,"url":9,"mix":493,"praise":93,"objection":106,"sub":21},34881286,-0.1,[21,24,25,26],"5000053500001005013333030300301151031153",[18,30,31,32],1793991060680]