[{"data":1,"prerenderedAt":382},["ShallowReactive",2],{"project-38587052":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":28,"sentiment":29,"stance_mix":30,"scored_comments":34,"aspects":35,"strip":43,"post_text":45,"what":46,"said":78,"maker_in_thread":165,"shape":175,"grid":179,"attempts":340,"same_week":345,"maker_shows":31,"maker_hidden":374,"reader_version":375,"card":376},"38587052","SecureAI Tools","Open source alternative to ChatGPT and ChatPDF-like AI tools","title","Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools","https:\u002F\u002Fgithub.com\u002FSecureAI-Tools\u002FSecureAI-Tools","github.com","d7y",1702162927,2023,234,60,220,3109,8,"notable","ai","llm chat interface","web_app",[24,25,26,27],"self-hosted llm","chat with pdf","ollama","rag chatbot","curious",-0.175,{"positive":31,"neutral":32,"mixed":31,"critical":33},1,15,7,24,{"idea":36,"performance":39,"privacy":41,"execution":42},{"positive":37,"critical":38},0,2,{"positive":37,"critical":40},3,{"positive":37,"critical":31},{"positive":37,"critical":31},[40,37,31,40,40,40,31,37,31,40,37,31,37,40,37,37,37,44,40,37,40,40,31,37,40,40,31,37,31,37,37,37,37,37,37,37,37,40,37,37],5,null,{"problem":47,"audience":54,"pricing":45,"motivation":45,"time_to_build":45,"stack":62,"openness":75,"stage":76,"team_size":77},{"value":48,"source":49,"evidence":50},"Running a ChatGPT-like interface and chat-with-documents over local or OpenAI-compatible LLMs","maker",[51],{"id":52,"by":11,"text":53},"38587053","Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with…",{"value":55,"source":56,"evidence":57},"Self-hosters and users wanting private LLM chat","inferred",[58,59],{"id":52,"by":11,"text":53},{"id":60,"by":11,"text":61},"38591858","It is secure because it allows you to fully customize where to process the data (i.e. LLM inference), where to store it, and data-retention policies, etc. You can choose to use a…",[63,71],{"value":64,"source":65,"evidence":66},"Docker","commenter",[67],{"id":68,"by":69,"text":70},"38589619","willi59549879","it runs an llm in a docker container. doesn't send any requests to chatgpt",{"value":72,"source":49,"evidence":73},"Ollama",[74],{"id":52,"by":11,"text":53},"open_source","beta","unknown",{"praise":79,"objections":91,"requests":115,"questions":139,"alternatives":151},[80],{"value":81,"source":65,"evidence":82},"Useful, well-timed open source tool",[83,87],{"id":84,"by":85,"text":86},"38587538","vunderba","Great job. This is a relatively crowded area, particularly RAG style chat systems. It might be nice for SecureAI to call out what makes their product different from other open…",{"id":88,"by":89,"text":90},"38625104","sunnysogra","Nice tool. However, these days, people are looking for something that is more feature-rich and can perform various tasks. Building an RAG system with a chat interface is common.…",[92,98,104,111],{"value":93,"source":49,"evidence":94},"Scanned PDFs and OCR not supported",[95],{"id":96,"by":11,"text":97},"38587480","Great questions. > 1. Does chat-with-pdfs function work with scanned PDFs? Not yet. We don't do OCR or anything to extract text from images yet. But that would be an awesome…",{"value":99,"source":49,"evidence":100},"Large PDF collections slow to index",[101],{"id":102,"by":11,"text":103},"38591735","Right now it supports selecting & uploading a _few_ PDFs on chat-creation. Those PDFs get indexed online -- i.e. while the user waits. So it doesn't scale well with the number of…",{"value":105,"source":65,"evidence":106},"Privacy claims unclear; demo uses ChatGPT",[107],{"id":108,"by":109,"text":110},"38590393","hifreq","The demo video is using ChatGPT.",{"value":112,"source":65,"evidence":113},"Crowded space versus existing tools",[114],{"id":84,"by":85,"text":86},[116,127,132],{"value":117,"source":65,"evidence":118},"Support for OCR and scanned PDFs",[119,123],{"id":120,"by":121,"text":122},"38587356","cheema33","I am very new to this field, so forgive my ignorance when I ask super basic questions. 1. Does chat-with-pdfs function work with scanned PDFs? 2. In the video example for…",{"id":124,"by":125,"text":126},"38587763","smeej","If I've already run OCR on my PDFs and that's added now as an invisible layer, would it work then? I've had a workflow digitizing my incoming paper documents, running OCR, and…",{"value":128,"source":65,"evidence":129},"Offline or bulk document indexing",[130,131],{"id":120,"by":121,"text":122},{"id":102,"by":11,"text":103},{"value":133,"source":65,"evidence":134},"Linux compatibility with Alpine and other distros",[135],{"id":136,"by":137,"text":138},"38587924","jart","I'm not able to use this locally on Alpine Linux because ollama needs glibc.",[140,147],{"value":141,"source":65,"evidence":142},"Can a directory of PDFs be queried?",[143],{"id":144,"by":145,"text":146},"38590150","teruakohatu","Can a directory of PDFs be queried or does it only support a single document?",{"value":148,"source":65,"evidence":149},"How does it differ from Danswer and Khoj?",[150],{"id":84,"by":85,"text":86},[152,156,160],{"value":153,"source":65,"evidence":154},"Danswer",[155],{"id":84,"by":85,"text":86},{"value":157,"source":65,"evidence":158},"Khoj",[159],{"id":84,"by":85,"text":86},{"value":161,"source":65,"evidence":162},"ChatPDF",[163,164],{"id":52,"by":11,"text":53},{"id":88,"by":89,"text":90},{"comments":166,"answered":33,"key":167},9,[168,171,174],{"id":169,"text":170},"38591764","I love the idea of allowing anyone to build apps or experiences on top of some of these common elements. We have briefly discussed an approach where we make some of these common…",{"id":172,"text":173},"38587663","> renaming PDFs Sorry, I didn't understand. Why do you need ML tool for renaming PDFs? or did you mean rephrasing or rewriting in a different format?",{"id":102,"text":103},{"commenters":176,"max_depth":177,"maker_replies":166,"first_comment_mins":37,"lifespan_hours":178},42,6,168,[180,184,188,190,194,197,201,204,207,211,215,218,221,224,228,230,232,234,237,240,243,246,249,251,255,257,259,261,263,265,268,269,270,271,273,276,279,282,285,288,289,291,292,295,297,300,303,306,309,311,313,316,319,321,323,326,329,331,334,336,338],[181,37,40,182,183,37],"38590601","project\u002Fneutral\u002Fidea","lysecret",[185,37,37,186,187,37],"38591034","other\u002Fneutral\u002Fnone","dluc",[169,37,37,189,11,31],"project\u002Fpositive\u002Fidea",[191,31,31,192,193,37],"38587929","project\u002Fcritical\u002Fidea","caseyf7",[195,31,40,182,196,37],"38587958","netcraft",[198,31,40,199,200,37],"38588097","project\u002Fneutral\u002Fnone","naiv",[202,31,40,199,203,37],"38588366","katrinarodri",[205,31,40,182,206,37],"38588138","capableweb",[208,31,40,209,210,37],"38596791","project\u002Fneutral\u002Fperformance","gosub100",[212,31,31,213,214,37],"38588198","project\u002Fcritical\u002Fperformance","freedomben",[216,31,37,186,217,37],"38588951","bravura",[219,31,37,186,220,37],"38589104","arthurcolle",[222,31,31,213,223,37],"38590731","saberience",[225,31,40,226,227,37],"38591320","project\u002Fmixed\u002Fidea","htsh",[229,31,37,186,214,37],"38593448",[231,31,37,186,223,37],"38594002",[233,31,31,192,223,37],"38593959",[235,31,40,182,236,37],"38588369","abraae",[238,31,37,186,239,37],"38588374","jrpt",[241,31,37,186,242,37],"38593543","qingcharles",[244,38,40,199,245,37],"38587600","abnry",[247,38,37,186,248,37],"38587661","Reptur",[172,38,37,250,11,31],"maker\u002Fneutral\u002Fnone",[252,38,37,253,254,37],"38587734","commenter\u002Fneutral\u002Fnone","mattsan",[256,38,37,253,245,37],"38587772",[258,38,37,186,217,37],"38588946",[88,40,44,260,89,37],"project\u002Fpositive\u002Fnone",[144,262,40,182,145,37],4,[102,262,37,264,11,31],"project\u002Fneutral\u002Fexecution",[266,262,37,267,11,31],"38668580","project\u002Fpositive\u002Fexecution",[120,44,40,199,121,37],[96,44,37,199,11,31],[124,44,40,199,125,37],[272,44,37,199,11,31],"38591800",[274,44,31,213,275,37],"38588392","lhuser123",[277,44,37,186,278,37],"38588976","catlifeonmars",[280,44,37,186,281,37],"38589497","rolisz",[283,177,40,284,109,37],"38589456","project\u002Fneutral\u002Fprivacy",[286,177,40,284,287,37],"38589564","glerk",[68,177,40,284,69,37],[108,177,31,290,109,37],"project\u002Fcritical\u002Fprivacy",[60,177,37,284,11,31],[293,33,37,186,294,37],"38591840","foxhop",[136,18,31,296,137,37],"project\u002Fcritical\u002Fexecution",[298,18,37,186,299,37],"38588269","yreg",[301,18,37,186,302,37],"38588317","testernews",[304,18,37,253,305,37],"38590120","stuzenz",[307,18,37,253,308,37],"38590789","hruzgar",[310,18,37,186,302,37],"38605778",[312,18,37,186,137,37],"38588774",[314,18,37,186,315,37],"38589455","number6",[317,18,37,186,318,37],"38590453","suslik",[320,18,37,186,315,37],"38593313",[322,18,37,186,281,37],"38589512",[324,166,37,186,325,37],"38589324","mikeytown2",[327,166,37,186,328,37],"38589838","oaththrowaway",[84,330,40,182,85,37],10,[332,330,37,186,333,37],"38588462","SubiculumCode",[335,330,37,186,85,37],"38589509",[337,330,37,189,11,31],"38591956",[52,339,37,182,11,31],11,[341,344],{"id":342,"t":343,"points":38,"comments":31},"38475872",1701363634,{"id":4,"t":12,"points":14,"comments":15},[346,350,354,359,364,369],{"id":347,"name":348,"points":349,"category":20},"38596953","Sagittarius",434,{"id":351,"name":352,"points":353,"category":20},"38611700","macOSpilot",430,{"id":355,"name":356,"points":357,"category":358},"38635695","Agora",317,"web_saas",{"id":360,"name":361,"points":362,"category":363},"38632970","CspChan",271,"languages",{"id":365,"name":366,"points":367,"category":368},"38612680","Advent of Distributed Systems",263,"learning_science",{"id":370,"name":371,"points":372,"category":373},"38577240","OSS Software",245,"other",false,"v2",{"id":377,"name":5,"line":6,"ai":374,"cat":20,"year":13,"points":14,"comments":15,"rec":28,"s":378,"top":18,"kw":379,"maker":11,"domain":10,"tier":19,"attempts":38,"strip":380,"url":9,"mix":381,"praise":81,"objection":93,"sub":21},38587052,-0.17,[24,25,26,27],"3013331013010300053033103310100000000300",[31,32,31,33],1794036645866]