promptfoo red teaming
AI
llm red teaming
SHOW HN2024
23points
2comments
#1,790of 3,515 in 2024
Top 51%of 2024 by points
How HN took it
QuietFewer than 5 comments about the project
0 positive, 1 neutral or asking, 0 mixed, 0 critical, out of 1 comments about the project.
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
promptfoo is a pleasant, flexible eval tool
From 1 comment
I haven't yet tried this red teaming tool, but I recently started using promptfoo to build out an evals pipeline for Plandex, a terminal-based AI coding tool I'm building[1].…
danenania on HN
Good foundation to build red teaming on top of
From 1 comment
I haven't yet tried this red teaming tool, but I recently started using promptfoo to build out an evals pipeline for Plandex, a terminal-based AI coding tool I'm building[1].…
danenania on HN
Requests
Support dynamic prompts and providers for continuous evaluation in production
From 1 comment
Can this be dynamic on prompts and providers? I’m thinking of continuous evaluation for LLM in production, where after each call, a webhook will send the input/output to evaluate.
Oras on HN
Questions
Can the tool run dynamically on prompts and providers?
From 1 comment
Can this be dynamic on prompts and providers? I’m thinking of continuous evaluation for LLM in production, where after each call, a webhook will send the input/output to evaluate.
Oras on HN
Alternatives named
promptfoo
From 1 comment
I haven't yet tried this red teaming tool, but I recently started using promptfoo to build out an evals pipeline for Plandex, a terminal-based AI coding tool I'm building[1].…
danenania on HN