shot-scraper-template
Dev tools
screenshot automation template
SHOW HN2022
shot-scraper-template
Instantly create a GitHub repository to take screenshots of a web page
simonwillison.net#github actions#screenshot#web scraping#playwright#github template
How HN took it
5 positive, 8 neutral or asking, 0 mixed, 1 critical, out of 14 comments about the project. Thread score +0.21.
Idea: 3 for, 0 againstExecution: 1 for, 1 againstPricing: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Good execution and cool idea
From 2 comments
GitHub does have some very generous free tier stuff. But as these sort of things become more common it's destined to be lowered or more heavily limited. Nothing against the…
dudus on HNThis is really cool and I love the idea of using SVGs to even add annotations, as you mentioned on your tweets. I might be "borrowing" that idea soon for some our own work, and…
cancan on HN
Objections
Free GitHub Actions minutes for public repos may be restricted later
From 2 comments
Love the project. Do you ever worry about Microsoft tightening the purse strings on these types of off-label uses for github?
0des on HNGitHub does have some very generous free tier stuff. But as these sort of things become more common it's destined to be lowered or more heavily limited. Nothing against the…
dudus on HN
Pages with slow loading or consent popups are not captured well
From 2 comments
Thanks for sharing! It does not work though for pages that take time to load (at best - image previous, at worst - only background. Any ideas how to change that?
stared on HNThis is an awesome tool, as all of yours! Just to mention: The example of french news websites shows that popovers and consent forms are a serious problem for this kind of…
uniqueuid on HN
Requests
Visual regression testing support
From 1 comment
This but automated visual regression testing (eg testing screenshots are the same) would be amazing. Anyone got any ideas how this might work with shot-scraper?
lloydatkinson on HN
Only commit screenshots when significantly changed
From 1 comment
I saw you were poking with some image diff tools recently as well, and I'm sure you've thought about this already but I'd just like to explicitly state it: it'd be great if you…
beardicus on HN
Favicon extraction
From 1 comment
That's fantastic! I'll definitely investigate using this. I implemented my own MacGyver version of this basic functionality off selenium to grab screenshots for…
marginalia_nu on HN
Questions
What limits prevent abuse as a web archive?
From 1 comment
What sort of limits are in place to keep people from setting up their own web archive with this?
dudus on HN
How to handle slow-loading pages?
From 1 comment
Thanks for sharing! It does not work though for pages that take time to load (at best - image previous, at worst - only background. Any ideas how to change that?
stared on HN
Alternatives named
Needle (Selenium visual regression)
From 1 comment
You could absolutely get this working with GitHub Actions with a bit of creativity. I've been playing around with my own image-diff tool for this kind of thing, but it's not yet…
simonw on HN
pixelmatch and puppeteer
From 1 comment
I used pixelmatch + puppeteer at a previous job to automate this. The service would screenshot each page on the master branch and the PR branch, then comment on the PR with a…
trevinhofmann on HN
Cypress visual regression
From 1 comment
Awesome Visual Regression Testing > lists quite a few tools and online services: https://github.com/mojoaxel/awesome-regression-testing#tools-and-frameworks "visual-regression":…
westurner on HN
thumbnail.ws
From 1 comment
I use https://thumbnail.ws/ via curl.
adriangrigore on HN