simple-llama-finetuner
AI
model finetuning tool
SHOW HN2023
449points
98comments
#66of 3,109 in 2023
Top 3%of 2023 by points
How HN took it
LovedMost comments that take a side are positive
7 positive, 10 neutral or asking, 0 mixed, 1 critical, out of 18 comments about the project. Thread score +0.26.
Idea: 5 for, 1 againstPerformance: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Useful beginner-friendly project
From 2 comments
Great job OP. Yesterday after managing to run local instance of alpaca.cpp and reading more about what alpaca is and how it got fine tuned on LLaMA, I began to wonder what will…
mattfrommars on HNVery interesting project, thanks. I see that DeepSpeed is on your TODO list. I wonder what the biggest LLaMA model is that can be fine-tuned on 2x RTX 3090 & 128GB RAM.
Tepix on HN
Objections
Questions the value of a tool that dumbs down finetuning
From 1 comment
my instance doesn't seem impressed: So, I stumbled upon this Simple LLaMA FineTuner project by Aleksey Smolenchuk, claiming to be a beginner-friendly tool for fine-tuning the…
yousnail on HN
Unclear what training screenshots show
From 2 comments
What do the training screenshot examples try to accomplish? In what way would the model be different after the example fine-tuning?
antman on HNSame question here!
rafaguin on HN
Requests
Support for DeepSpeed
From 1 comment
Very interesting project, thanks. I see that DeepSpeed is on your TODO list. I wonder what the biggest LLaMA model is that can be fine-tuned on 2x RTX 3090 & 128GB RAM.
Tepix on HN
Run on smaller GPUs like a 3080 with 16GB VRAM
From 1 comment
This is awesome! I noticed it said a prereq is >16GB VRAM — is that >= 16GB, or is it really explicitly greater than 16? Would be sweet to be able to finetune locally on, say, a…
reissbaker on HN
Questions
How much VRAM is needed to finetune the 65B model
From 1 comment
What would it take to fine tune the 65B?
Taek on HN
Can it be finetuned on CPU only
From 1 comment
Is it possible to fine-tune using CPU only?
sea_temple on HN
Alternatives named
Alpaca-LoRA
From 1 comment
my instance doesn't seem impressed: So, I stumbled upon this Simple LLaMA FineTuner project by Aleksey Smolenchuk, claiming to be a beginner-friendly tool for fine-tuning the…
yousnail on HN
text-generation-webui
From 1 comment
> With no real knowledge of LLM and only recently started to understand what LLM terms mean, such as 'model, inference, LLM model, intruction set, fine tuning' whatelse do you…
lxe on HN