Langfuse

Dev tools

llm observability

SHOW HN2023

143points
35comments
#443of 3,109 in 2023
Top 15%of 2023 by points

How HN took it

CuriousMostly questions and neutral comments

6 positive, 14 neutral or asking, 1 mixed, 2 critical, out of 23 comments about the project. Thread score +0.22.

Idea: 3 for, 2 againstExecution: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Open source and clear value proposition

    From 3 comments
    • > We will need to move to an OLAP database soon and are debating if we need to start batching ingestion Highly recommend https://tinybird.com for this – they're a fantastic OLAP…
      steventey on HN
    • Congrats on the launch! I have quite a few years of observability experience behind me and hand't really considered some of the unique aspects that LLMs bring into the picture.…
      addisonj on HN
    • looks awesome ! love that it's Open-source too
      ij23 on HN
  • LLM-specific observability is a real underserved need

    From 2 comments
    • Awesome. There is a definitely a need for LLM product analytics that is currently completely underserved by traditional tools like GA, Mixpanel, etc.
      elamje on HN
    • Congrats on the launch! I have quite a few years of observability experience behind me and hand't really considered some of the unique aspects that LLMs bring into the picture.…
      addisonj on HN

Objections

  • Should support OpenTelemetry rather than a custom SDK

    From 3 comments
    • Congrats on the release! I'm keenly interested in this space, as I believe that Observability is one of the top ways to steer LLMs to be more reliable in production. I noticed…
      phillipcarter on HN
    • +1 on the OTel mention. Having telemetry in place in a system, one would typically implement a single behavioral tracking SDK on top. Adding yet another SDK for LLMs is a hard…
      hrpnk on HN
    • Congrats on the launch! I have quite a few years of observability experience behind me and hand't really considered some of the unique aspects that LLMs bring into the picture.…
      addisonj on HN
  • Pricing by storage may cause cost variance versus events per second

    From 1 comment
    • Congrats on the launch! I have quite a few years of observability experience behind me and hand't really considered some of the unique aspects that LLMs bring into the picture.…
      addisonj on HN

Requests

  • OpenTelemetry support

    From 2 comments
    • Congrats on the release! I'm keenly interested in this space, as I believe that Observability is one of the top ways to steer LLMs to be more reliable in production. I noticed…
      phillipcarter on HN
    • Congrats on the launch! This is really cool. Would love to see OTel integration in the future. I'm curious if this might eventually work with request-context based routing, i.e.…
      anirudhrx on HN
  • Replace Looker Studio with an open-source analytics option

    From 2 comments
    • The maker's post
    • If you’re looking to replace Looker with open source and the ability to style it to your needs maybe a mix of cube.dev plus tremor.so would do the trick?
      fiehtle on HN

Questions

  • How does it compare to Datadog LLM monitoring?

    From 1 comment
    • Congrats on the launch! Curious to learn what specific use case you have seen around observability of LLM apps which are not covered by standard observability tools like DataDog,…
      pranay01 on HN
  • Timescale or ClickHouse as the OLAP choice?

    From 2 comments
    • The maker's post
    • I’m curious if you investigated the TimescaleDB extension that is built into Supabase for your usecase? And if so, what was the pros and cons?
      kaspermarstal on HN

Alternatives named

  • Datadog

    From 1 comment
    • Congrats on the launch! Curious to learn what specific use case you have seen around observability of LLM apps which are not covered by standard observability tools like DataDog,…
      pranay01 on HN
  • SigNoz

    From 1 comment
    • Congrats on the launch! Curious to learn what specific use case you have seen around observability of LLM apps which are not covered by standard observability tools like DataDog,…
      pranay01 on HN
  • Lightdash

    From 1 comment
  • Cube.dev with tremor

    From 1 comment
    • If you’re looking to replace Looker with open source and the ability to style it to your needs maybe a mix of cube.dev plus tremor.so would do the trick?
      fiehtle on HN
  • Tinybird

    From 1 comment
    • > We will need to move to an OLAP database soon and are debating if we need to start batching ingestion Highly recommend https://tinybird.com for this – they're a fantastic OLAP…
      steventey on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/37310070)