CloudQuery
Dev tools
web scraping api generator
SHOW HN2019
117points
23comments
#399of 2,195 in 2019
Top 19%of 2019 by points
How HN took it
LovedMost comments that take a side are positive
4 positive, 7 neutral or asking, 0 mixed, 0 critical, out of 11 comments about the project. Thread score +0.23.
Idea: 4 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Useful idea, similar to Kimono and Yahoo Pipes
From 3 comments
Looks great, reminds me of Kimono labs.
leowoo91 on HNLOVED Kimonify, especially how it (somehow!) figured out the pattern of data after clicking on a few different items. This is very close to that, minus the pattern recognition.
LikeAnElephant on HNI was able to do this 10 years ago with Yahoo!Pipes :(
hiccuphippo on HN
Objections
Copyright concerns such as EU Article 13 could affect scraping-based feeds
From 1 comment
Nice. I've been toying with the same idea, but with optional RSS formatting to be able to generate an RSS feed from any website. What's stopping me though is the EUs Article 13,…
Jaruzel on HN
Requests
Support for pages behind login
From 1 comment
Very neat idea! I like do this locally in Emacs (by scraping `M-x eww` output!), but having an API is a great idea! How would you go about using it on sites that require login…
mrspeaker on HN
Graphical element selection for extraction
From 1 comment
You can do this now with https://www.pipes.digital/ :) And I'm actually working on making the extract block more powerful, having a graphical way to select elements.
onli on HN
Questions
What is the use case?
From 1 comment
What's the use case of this tool?
lugrugzo on HN
Is running headless Chrome on Lambda expensive?
From 1 comment
Very neat idea! I like do this locally in Emacs (by scraping `M-x eww` output!), but having an API is a great idea! How would you go about using it on sites that require login…
mrspeaker on HN
Alternatives named
Yahoo Pipes
From 2 comments
I was able to do this 10 years ago with Yahoo!Pipes :(
hiccuphippo on HNWhere's Yahoo! Pipes when you need them...
dmitriid on HN
Kimono Labs
From 1 comment
Looks great, reminds me of Kimono labs.
leowoo91 on HN
Feedity
From 1 comment
This looks good! * Shameless plug *: Our little startup, Feedity - https://feedity.com, helps create XML/RSS feeds for any public webpage, even JS/XHR/SPAs and social networks…
nreece on HN
wrapapi
From 1 comment
I use a very similar tool (https://wrapapi.com/) to generate JSON feeds for From Founders (https://www.fromfounders.com/). I noticed that lots of these founder interview sites…
karlhughes on HN
Pipes Digital
From 1 comment
You can do this now with https://www.pipes.digital/ :) And I'm actually working on making the extract block more powerful, having a graphical way to select elements.
onli on HN