content-parser

Dev tools

web content extraction api

SHOW HN2022

49points
7comments
#978of 2,570 in 2022
Top 39%of 2022 by points

How HN took it

QuietFewer than 5 comments about the project

0 positive, 2 neutral or asking, 0 mixed, 2 critical, out of 4 comments about the project.

Idea: 0 for, 1 againstPricing: 0 for, 1 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Commenters like the stripped-down web reading idea

    From 1 comment
    • I wrote something similar so I could save recipes and web pages for reading offline. And if you save in html, it will inline images, so you can have a single file. In markdown,…
      bprew on HN

Objections

  • Readability misses content on some pages, so it is finicky

    From 1 comment
    • I wrote something similar so I could save recipes and web pages for reading offline. And if you save in html, it will inline images, so you can have a single file. In markdown,…
      bprew on HN
  • Free web clippers and archive sites already do this

    From 1 comment
    • I wrote something similar so I could save recipes and web pages for reading offline. And if you save in html, it will inline images, so you can have a single file. In markdown,…
      bprew on HN
  • Per-page cost claim seems high for serverless compute

    From 1 comment
    • Can you expand on this statement "It costs me only several cents to parse an entire page"? That sounds like quite a lot to me. We're talking _maybe_ a few seconds of compute time…
      masukomi on HN

Requests

  • Option to enable or disable JavaScript

    From 1 comment
    • I maintain something similar today, and I'm guessing that the OP uses some combination of the following libraries too (?): - Readability (https://github.com/mozilla/readability)…
      saltymimir on HN
  • Front matter metadata option

    From 1 comment
    • I maintain something similar today, and I'm guessing that the OP uses some combination of the following libraries too (?): - Readability (https://github.com/mozilla/readability)…
      saltymimir on HN
  • Bypass paywalls by changing user agent or redirecting to archive

    From 2 comments
    • I maintain something similar today, and I'm guessing that the OP uses some combination of the following libraries too (?): - Readability (https://github.com/mozilla/readability)…
      saltymimir on HN
    • Could you automate browsing to an archive link instead when a link runs to a common paywalled site?
      neodymiumphish on HN

Questions

  • How is paywall bypassing done, such as by archive.today

    From 1 comment
    • Archive.today is exceptional at bypassing paywalls (any idea how?) This doesn't seem to work on Bloomberg articles for example.
      akrymski on HN
  • How much does it cost to parse a page

    From 1 comment
    • Can you expand on this statement "It costs me only several cents to parse an entire page"? That sounds like quite a lot to me. We're talking _maybe_ a few seconds of compute time…
      masukomi on HN

Alternatives named

  • Clippy (open source recipe and web page saver)

    From 1 comment
    • I wrote something similar so I could save recipes and web pages for reading offline. And if you save in html, it will inline images, so you can have a single file. In markdown,…
      bprew on HN
  • Archive.today

    From 1 comment
    • Archive.today is exceptional at bypassing paywalls (any idea how?) This doesn't seem to work on Bloomberg articles for example.
      akrymski on HN
  • Evernote web clipper

    From 1 comment
    • I wrote something similar so I could save recipes and web pages for reading offline. And if you save in html, it will inline images, so you can have a single file. In markdown,…
      bprew on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/32788010)