Scraperjs
Languages and libraries
scraping library
SHOW HN2014
192points
36comments
#108of 2,272 in 2014
Top 5%of 2014 by points
How HN took it
LovedMost comments that take a side are positive
6 positive, 8 neutral or asking, 1 mixed, 1 critical, out of 16 comments about the project. Thread score +0.23.
Idea: 3 for, 0 againstDocs: 0 for, 1 againstPerformance: 1 for, 0 againstDesign: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Router aspect is a nice idea
From 1 comment
I really like the router aspect of this. That's a nice idea and not (to the best of my limited memory) one I can recall seeing in any other scraper.
bshimmin on HN
Cheerio backend is much faster than PhantomJS for static pages
From 1 comment
For instances where you don't need a full featured browser to get the data you need, Scraperjs using the Cheerio backend should be WAY faster than casper/phantom. I've not used…
jdc0589 on HN
Objections
Install instructions unclear
From 1 comment
It's unclear to me how to actually run this. Only executing the two commands listed under the Installing section does not run it - I had to `cd` into the scraperjs dir, then `npm…
brianzelip on HN
Promises usage disliked
From 1 comment
Looks pretty good, shame about the promises.
woah on HN
Requests
Comparison with CasperJS in docs
From 1 comment
It would be helpful if the documentation compared how Scraperjs is different from, or better than, CasperJS for scraping. CasperJS is the older and more well-known wrapper around…
jasode on HN
Questions
How to use it in a project and whether to install per project
From 1 comment
It's unclear to me how to actually run this. Only executing the two commands listed under the Installing section does not run it - I had to `cd` into the scraperjs dir, then `npm…
brianzelip on HN
Use cases for DynamicScraper
From 1 comment
I don't quite get the point of the DynamicScraper... Any real use cases for that?
mr5iff on HN
Alternatives named
CasperJS
From 2 comments
It would be helpful if the documentation compared how Scraperjs is different from, or better than, CasperJS for scraping. CasperJS is the older and more well-known wrapper around…
jasode on HNAs far as I can see it has not much in common with casperjs, apart from the fact that it can use phantomjs.
thibauts on HN
Scrapy
From 1 comment
I think Scrapy is a better Python scraping tool.
cridenour on HN
Mechanize
From 1 comment
Check out Mechanize: https://github.com/sparklemotion/mechanize I haven't used the ruby version but I am pretty happy with the python port of it. It's lighter and faster than…
wc- on HN