Countless.dev
AI
model comparison
SHOW HN2024
361points
76comments
#136of 3,515 in 2024
Top 4%of 2024 by points
How HN took it
CuriousMostly questions and neutral comments
4 positive, 19 neutral or asking, 3 mixed, 8 critical, out of 34 comments about the project. Thread score -0.11.
Execution: 0 for, 3 againstIdea: 0 for, 3 againstDesign: 1 for, 0 againstPricing: 1 for, 0 againstPerformance: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Clean UI and table layout
From 2 comments
Love the UI and table layout. Have you though about showing the different VRAM requirements for models?
tonetegeatinst on HNthanks for the comparison table! would be great if the header is sticky so i don't get lost in identifying which column is which.
alif_ibrahim on HN
Useful price comparison
From 2 comments
Hey this is great! A small suggestion, a toggle to exclude between "free" and hosted models. Reason is, I'm obv. interested in seeing the cheaper models first but am not…
moralestapia on HNGreat! I wish there was a "bang to buck" value. Some way to know the cheapest model I could use for creating structured data from unstructured text, reliably. Using gpt4o-mini…
karpatic on HN
Objections
Missing many TTS and STT models
From 4 comments
This is missing... so many models... like most TTS and STT ones. 11labs, deepgram, etc.
dangoodmanUT on HN"every" you're missing a lot TTS: 11labs, PlayHT, Cartesia, iFLYTEK, AWS Polly, Deepgram Aura STT: Deepgram (multiple models, including Whisper), Gladia Whisper, Soniox just off…
tomp on HNThere are only two audio transcription models. Is this generally true, are there no open source ones like llama but for transcribing? Or just small dataset on that site
politelemon on HNI want to point out you dodged the data question, and there's a reason for it. I like your work visually on first glance, god knows you're right about gradio, even if its…
refulgentis on HN
Data is outdated
From 2 comments
Data in this tool is from https://artificialanalysis.ai/ on October 13 2024 and so is a little of out date. This page has up to date information of all models and providers:…
Gcam on HNI want to point out you dodged the data question, and there's a reason for it. I like your work visually on first glance, god knows you're right about gradio, even if its…
refulgentis on HN
Lacks benchmark quality scores
From 2 comments
This is interesting price-wise, but quality-wise if you do not provide benchmark results, it's not that helpful a comparision.
mentalgear on HNI'm missing the "IQ" column.
amelius on HN
Requests
Add benchmark or leaderboard scores such as LMArena
From 2 comments
It would be great if llmarena leadership information would also appear to compare performance vs cost.
mcklaw on HNNice resource. Almost too comprehensive for someone who doesn't know all the sub-version names. Would be great to have a column of the score from lmarena leaderboard. Some prices…
xnx on HN
Add sticky table header and sorting on cost columns
From 2 comments
thanks for the comparison table! would be great if the header is sticky so i don't get lost in identifying which column is which.
alif_ibrahim on HNCan you please consider adding sort options to the cost columns in the Pricing Calculator?
ikishorek on HN
Add links to provider pricing pages
From 2 comments
And a link to the company page where one can use/subscribe to the model
kmoser on HNWould be great if it was possible to get to the page where the pricing was found to make it easier to use the model
Its_Padar on HN
Add a free versus hosted model filter
From 1 comment
Hey this is great! A small suggestion, a toggle to exclude between "free" and hosted models. Reason is, I'm obv. interested in seeing the cheaper models first but am not…
moralestapia on HN
Questions
Are independent analyses planned or only aggregated limits
From 1 comment
I like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this…
ursaguild on HN
Why do Azure prices differ from OpenAI
From 1 comment
It's weird that OpenAI has lower prices for same models and Azure has higher prices. Anyone can explain? BTW impressive idea and upvoted on PH as well.
shahzaibmushtaq on HN
Alternatives named
Artificial Analysis
From 2 comments
Data in this tool is from https://artificialanalysis.ai/ on October 13 2024 and so is a little of out date. This page has up to date information of all models and providers:…
Gcam on HNI like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this…
ursaguild on HN
whatllm.vercel.app
From 1 comment
OP, were you inspired by this LLM comparison tool? https://whatllm.vercel.app The tables are very similar - though you've added a custom calculator which is a nice touch. Also…
vunderba on HN
llmprices.dev
From 1 comment
you guys might also like http://llmprices.dev, similar but it's automatically updated with the latest info every 24h
nikvdp on HN
lmarena.ai
From 1 comment
https://lmarena.ai
ursaguild on HN