Promptfoo
Dev tools
prompt testing cli
SHOW HN2023
14points
5comments
#2,012of 3,109 in 2023
Top 65%of 2023 by points
How HN took it
QuietFewer than 5 comments about the project
1 positive, 0 neutral or asking, 0 mixed, 0 critical, out of 1 comments about the project.
Design: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Good idea; CLI suits running many use cases
From 1 comment
This is a good idea, I used gradio and streamlit to list outputs from different models to check the output manually. But using CLI makes more sense for running multiple use cases…
Oras on HN
Requests
Add a config file (yaml or json) for prompts, variables and models
From 1 comment
This is a good idea, I used gradio and streamlit to list outputs from different models to check the output manually. But using CLI makes more sense for running multiple use cases…
Oras on HN
Add an init command to scaffold files
From 2 comments
This is a good idea, I used gradio and streamlit to list outputs from different models to check the output manually. But using CLI makes more sense for running multiple use cases…
Oras on HNThanks for the suggestion! I've added a `promptfoo init` command so the initial scaffolding is much easier.
typpo on HN
Questions
How does it compare to OpenPlayground?
From 1 comment
https://github.com/nat/openplayground How does this compare to Nat's OpenPlayground? Vercel recently launched a playground too.
brianjking on HN
Alternatives named
OpenPlayground by Nat
From 1 comment
https://github.com/nat/openplayground How does this compare to Nat's OpenPlayground? Vercel recently launched a playground too.
brianjking on HN
Vercel playground
From 2 comments
https://github.com/nat/openplayground How does this compare to Nat's OpenPlayground? Vercel recently launched a playground too.
brianjking on HNLooks like the playground is mainly for comparison between models, not prompts, and doesn't support templating? Vercel's is similar but not free and open-source. I'm running…
typpo on HN