Zeekstd

Languages and libraries

compression library

SHOW HN2025

214points
46comments
#287of 3,837 in 2025
Top 8%of 2025 by points

How HN took it

CuriousMostly questions and neutral comments

5 positive, 19 neutral or asking, 0 mixed, 1 critical, out of 25 comments about the project. Thread score +0.20.

Idea: 4 for, 0 againstDesign: 0 for, 1 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Useful for seekable compressed data and random access

    From 2 comments
    • This is very cool. Nice work! At my day job, I have been using a Go library[1] to build tools that require seekable zstd, but felt a bit uncomfortable with the lack of broader…
      simeonmiteff on HN
    • This is really cool! It strikes me as being useful for genomic data, which is always stored in compressed chunks. That was the first time I really understood the hard trade-off…
      conradev on HN

Objections

  • Seekable format is not standardized

    From 1 comment

Requests

  • Support for seeking to an offset without computing frames

    From 1 comment
    • Correct me if I'm wrong, but it doesn't seem like you provide the equivalent of Seekable::decompress in zstd_seekable which decompresses at a specific offset, without having to…
      tyilo on HN
  • Support for piping seekable files via stdin

    From 1 comment
    • great I can use it to pipe large logfiles and store for later retrival. is there something like zcat also?
      DesiLurker on HN

Questions

  • How does it compare to zstd_seekable crate

    From 1 comment
    • I already use zstd_seekable (https://docs.rs/zstd-seekable/) in a project. Could you compare the API's of this crate and yours?
      tyilo on HN
  • Support for custom dictionaries

    From 1 comment
    • This is cool, I'd say that the most common tool in this space is bgzip[1]. Have you thought about training a dictionary on the first few chunks of each file and embedding the…
      stu2010 on HN

Alternatives named

  • zstd_seekable crate

    From 1 comment
    • I already use zstd_seekable (https://docs.rs/zstd-seekable/) in a project. Could you compare the API's of this crate and yours?
      tyilo on HN
  • bgzip

    From 1 comment
    • This is cool, I'd say that the most common tool in this space is bgzip[1]. Have you thought about training a dictionary on the first few chunks of each file and embedding the…
      stu2010 on HN
  • zstd-seekable-format-go

    From 1 comment
    • This is very cool. Nice work! At my day job, I have been using a Go library[1] to build tools that require seekable zstd, but felt a bit uncomfortable with the lack of broader…
      simeonmiteff on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/44284871)