Opik
AI
llm evaluation framework
SHOW HN2024
How HN took it
2 positive, 3 neutral or asking, 1 mixed, 0 critical, out of 6 comments about the project. Thread score +0.22.
Idea: 2 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Promising tool; useful for local experimentation with Ollama
From 1 comment
It looks very promising! Congratulations, great tool! I can't wait to start experimenting with it. I plan to use it locally, with Ollama.
tcsizmadia on HN
Useful for university AI testing and QA course
From 1 comment
I'm in a University course related to AI testing and quality assurance. This is something I'll definitely bring up and see how it can be used. With OpenAI comparability, hoping…
trolan on HN
Objections
Colab ollama example threw a connection error on cell 2
From 1 comment
Ran through some colabs. Signed up for a key and tested the ollama colab. Got a little error on cell 2, "ConnectError: [Errno 99] Cannot assign requested address" but the traces…
itssteadyfreddy on HN
Requests
OpenTelemetry compatible ingestion endpoints
From 1 comment
Good question! It mostly came down to implementation speed, as well as some uncertainty about performance/overhead. We will be releasing OpenTelemetry compatible ingestion…
calebkaiser on HN
Out-of-the-box OpenRouter support
From 1 comment
I'm in a University course related to AI testing and quality assurance. This is something I'll definitely bring up and see how it can be used. With OpenAI comparability, hoping…
trolan on HN
Questions
How does it compare to Arize Phoenix?
From 1 comment
Ran through some colabs. Signed up for a key and tested the ollama colab. Got a little error on cell 2, "ConnectError: [Errno 99] Cannot assign requested address" but the traces…
itssteadyfreddy on HN
Why Java for the backend instead of Python?
From 1 comment
Looks interesting, great to see it specifically calls out supporting LLM servers as first class citizens! I see some of the code is Java, that strikes me as an interesting choice…
smcleod on HN
Why not implement OpenTelemetry directly?
From 1 comment
Is there a reason you didn't just implement OpenTelemetry (OT) straight away? Curious about the trade offs to opt for a home-grown telemetry inspired by OT instead.
hrpnk on HN
How does it compare to DeepEval?
From 1 comment
Hello! How does it compare to DeepEval (open source)?
yu3zhou4 on HN
Alternatives named
DeepEval
From 1 comment
Hello! How does it compare to DeepEval (open source)?
yu3zhou4 on HN
Arize Phoenix
From 1 comment
Ran through some colabs. Signed up for a key and tested the ollama colab. Got a little error on cell 2, "ConnectError: [Errno 99] Cannot assign requested address" but the traces…
itssteadyfreddy on HN
OpenLLMetry
From 1 comment
Have you seen two “prototypes” of standard for LLM telemetry? One is openllmetry, maintained by the folks at TraceLoop. Seems the more popular. The other one is openinference…
baggiponte on HN
OpenInference
From 1 comment
Have you seen two “prototypes” of standard for LLM telemetry? One is openllmetry, maintained by the folks at TraceLoop. Seems the more popular. The other one is openinference…
baggiponte on HN