HTML-to-Markdown
Dev tools
html to markdown converter
SHOW HN2024
How HN took it
7 positive, 13 neutral or asking, 0 mixed, 1 critical, out of 21 comments about the project. Thread score +0.33.
Idea: 3 for, 0 againstExecution: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Useful tool for feeding LLMs and building AI apps.
From 2 comments
This is really nice, especially for feeding LLMs web page data (they generally understand markdown well). I built something similar for the Elixir world but it’s much more…
cpursley on HNI have been using these two: https://farnots.github.io/RedditToMarkdown/ https://urltomarkdown.com/ Incredibly useful for leveraging LLMs and building AI apps.
paradite on HN
Better than pandoc for HTML to Markdown in some cases.
From 2 comments
Pandoc is amazing. Especially because they support so many formats. And their html to markdown converter is (in my opinion) still the best right now. But html-to-markdown is…
JohannesKauf on HNThis is nice, I tried a plugin for pandoc in the past but didn't really work well.
lollobomb on HN
Objections
Does not handle JavaScript-driven sites; needs a headless browser.
From 1 comment
That is unfortunately out of scope. I like the philosophy of doing one thing really well. But nowadays—with Playwright and Puppeteer—there are great choices for Browser automation.
JohannesKauf on HN
Requests
Built-in extraction of main article content like Readability.
From 2 comments
There are two parts to it: 1) convert html to markdown This is what my library specifically addresses, and I believe it handles this task robustly. There was a lot of testing…
JohannesKauf on HNThis is probably out of scope for your tool but it’d be nice to have built in n-gram deduplication where the tool strips any identical content from the header and footer, like…
throwup238 on HN
Support for syntax-highlighted code blocks.
From 1 comment
One of the pain points of using this kind of tools is handling syntax highlighted code blocks. How does html-to-markdown perform in such scenarios?
juliuskiesian on HN
Questions
Does it handle JS-driven sites?
From 1 comment
Does it also include logic to download JS-driven sites properly or is this out of scope?
oezi on HN
Is there a Kotlin or Spring library for this?
From 1 comment
I have been looking for a similar lib to use in a Kotlin/Spring app - any recommendations? My specific use-case does not need to support sanitizing during the HTML -> MD…
ssousa666 on HN
Alternatives named
Pandoc
From 2 comments
Pandoc http://www.cantoni.org/2019/01/27/converting-html-markdown-using-pandoc
NotACracker on HNI remember a long time ago I used Pandoc for this. Fresh tools and more choice is very welcome, thanks for your work!
Savageman on HN
Jina Reader
From 1 comment
If you need this sort of thing in any other language, there's a free, no-auth, no-api-key-required, no-strings-attached API that can do this at https://jina.ai/reader/ You just…
miki123211 on HN
Turndown
From 1 comment
Turndown works quite well too: https://github.com/mixmark-io/turndown
yayoohooyahoo on HN
Mozilla Readability
From 1 comment
I used https://github.com/mozilla/readability for this
bni on HN