ChatLLaMA
AI
chatbot interface
SHOW HN2023
402points
215comments
#78of 3,109 in 2023
Top 3%of 2023 by points
How HN took it
MixedNo clear lean
13 positive, 52 neutral or asking, 1 mixed, 40 critical, out of 106 comments about the project. Thread score -0.29.
Performance: 8 for, 20 againstExecution: 0 for, 14 againstIdea: 2 for, 1 againstDesign: 1 for, 2 againstPrivacy: 0 for, 2 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
UI looks great.
From 1 comment
The UI looks great, but I only get "Something went wrong, please try again." after a while waiting for the response :(
Al-Khwarizmi on HN
Performs better than running llama.cpp locally for some tasks.
From 2 comments
This performs considerably better than simply running llama.cpp. I've tested with 7b, 13b and 30b parameters alpaca models locally and I couldn't get them to produce accurate…
kobalsky on HNTheir 7b model performs much better than the 13b model I have running locally with alpaca.cpp. I think this is because (looking at their code) they stick with the float16…
UncleOxidant on HN
Objections
Responses are inaccurate, repetitive, or hallucinated.
From 4 comments
It seems it gets stuck in pseudo infinite loops sometimes. Can you provide a step by step guide on how to get dressed for a five years old? 1. Start by putting on underwear and…
satellite2 on HN> me: what does Hegel think about negativity? > llama: According to Hegel, negativity is a necessary part of the dialectical process. He believed that negativity is the driving…
nathias on HNI asked "Who are you?" and it replied "I am a 25-year-old woman from the United States. I have a bachelor's degree in computer science and a master's degree in artificial…
mdrzn on HNall these "chatGPT style" projects seem not to be able to refer to previous messages.Nice UI though :) What's an alpaca? > An alpaca (Vicugna pacos) is a domesticated species of…
chrisMyzel on HN
Slow responses and errors under load.
From 2 comments
This is way too slow
Abecid on HNThe UI looks great, but I only get "Something went wrong, please try again." after a while waiting for the response :(
Al-Khwarizmi on HN
No memory of previous messages in the conversation.
From 2 comments
Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting…
aaronrelph on HNChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a…
zevv on HN
Commercial use of LLaMA may violate Meta's license.
From 2 comments
>> Not trying to shill anything; just want to build and share cool stuff. Any commercial use of Facebook’s LLaMa remains a violation of the software’s terms of use to my…
O__________O on HNHow did you get past the non-commercial license ?
mlboss on HN
Requests
Support for conversation context or memory.
From 2 comments
ChatGPT keeps track of context in a "discussion", but I found that alpaca 7B has no memory of what was said by the user or the model before, so each question gets answered with a…
zevv on HNMe: what is a symbol table used for in a compiler ? ChatLLaMa: A symbol table is a data structure used by compilers to keep track of variables, functions, and other identifiers.…
HarHarVeryFunny on HN
Detailed instructions for running 65B model.
From 1 comment
anyone know where to get the latest information on progress on training Alpaca on the 65B llama model? I've seen a few reports on Twitter etc of people running the llama CPP…
sixhobbits on HN
Questions
How is fine-tuning different from few-shot learning on own documents?
From 2 comments
Does "fine tuning the dataset" in this context mean I could point it at my own projects documentation and get conversational & relevant answers or does it mean something else?
bongobingo1 on HNHow much better would fine tuning be vs few shot learning over own corpus of text?
monkeydust on HN
Is this related to the nebullvm ChatLLama project?
From 1 comment
Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm ?
minxomat on HN
Alternatives named
alpaca.cpp and llama.cpp run locally
From 2 comments
Their 7b model performs much better than the 13b model I have running locally with alpaca.cpp. I think this is because (looking at their code) they stick with the float16…
UncleOxidant on HNThis performs considerably better than simply running llama.cpp. I've tested with 7b, 13b and 30b parameters alpaca models locally and I couldn't get them to produce accurate…
kobalsky on HN
Dalai
From 1 comment
I'm a newbie to this stuff, but I did manage to get Dalai Llama up and running with llama and alpaca 7B and 13B. The results I get seem to be random spitouts of reddit or…
cabaalis on HN
ChatGPT
From 2 comments
Rap battle between ChatGPT and ChatLLaMA (made by copy/pasting responses from one to the other). Note that ChatLLaMA manages to confuse ChatGPT about who is who. == ChatLLaMA:…
elil17 on HNMe: How can I convince my 5 year old to put her shoes on in a timely fashion each morning? Answer in table form. LLaMA: 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4.…
dmd on HN