22120
Infrastructure
self-hosted archiving
SHOW HN2019
How HN took it
9 positive, 20 neutral or asking, 2 mixed, 5 critical, out of 36 comments about the project. Thread score +0.09.
Idea: 9 for, 2 againstExecution: 0 for, 2 againstDesign: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Clever idea using browser debug protocol to archive everything
From 3 comments
Really brilliant implementation concept. I love how it uses the browsers debug port to save literally everything. I have often dreamed of “a Google for everything I’ve seen…
jchook on HNLike 20 years ago I've used a program called Teleport Pro, to do something similar. I would dial up with my phone modem when the internet access was cheap (during the night), it…
EastSmith on HNGreat idea! I like the concept. One of the things I miss most about the old web was how trivial it was to local mirror any website. It was great!
jdmoreira on HN
Useful tool for forensic or personal archiving
From 1 comment
Between this project and the others mentioned in the discussion these are excellent resources for anyone needing to have a forensic record of their how they assembled evidence…
mikece on HN
Objections
Saving every page would use large storage over time
From 1 comment
I remember I tried something similar a long time ago but decided it wasn't worth it. 2MB per page at 100 page a day, 200MB / day. That is 73GB per year. May be once a year I get…
ksec on HN
Keeping whole cache in memory and rewriting JSON will not scale
From 1 comment
Congrats on getting your project to the front page of HN. With that said I think you are going to need to change your approach if you want this project to be usable as more than…
thefreeman on HN
Remote debugging mode raises security concerns
From 1 comment
what are the security implications of permanently running chrome in remote debug mode? a bit more than half a year ago I started playing around with this and was surprised how on…
aloer on HN
Only works in Chrome-based browsers
From 1 comment
I love how there's only a single browser or two in the entire world, lol (safari I've got bo clue about) that's while assuming chrome and firefox's debugging streams would be…
jan6 on HN
Requests
Use a proper database or per-URL disk storage instead of one in-memory cache
From 2 comments
Congrats on getting your project to the front page of HN. With that said I think you are going to need to change your approach if you want this project to be usable as more than…
thefreeman on HNYou could store the data in a git repo per domain, so that implicit de-duplication happens on re-visits & for shared resources. You could have a raw dir (the files you receive…
grizzles on HN
Provide a proxy-based or simpler way to capture without enabling debugger
From 2 comments
Nice job, I think this is promising but there has got to be a better way than having people enable their debugger. Is there any reason you can't just copy the contents of each…
calpaterson on HNWhy not use a proxy?
mauricesvay on HN
Mobile support
From 1 comment
> Storage is so dirt cheap today that there is zero reason why we shouldn't have reliable historic website state for everything we have ever looked at I agree entirely, but I do…
sneak on HN
Questions
What are the security implications of running Chrome in remote debug mode
From 2 comments
what are the security implications of permanently running chrome in remote debug mode? a bit more than half a year ago I started playing around with this and was surprised how on…
aloer on HN> - fetch('http://localhost:9222/json') which errors or is opaque because it is non CORS, or What about DNS rebinding attacks?
arkadiyt on HN
Why use DevTools instead of an HTTP proxy
From 2 comments
I’m curious of why did you go on the path of using chrome debugging functionality instead of implementing an HTTP proxy which would provides the benefit of behind…
Eikon on HNWhy not use a proxy?
mauricesvay on HN
Alternatives named
Chronicler
From 1 comment
Bump for my related project: https://github.com/CGamesPlay/chronicler I'm actually in the process of rewriting this. I like your approach of using DevTools to manage the…
CGamesPlay on HN
SingleFile
From 1 comment
For your information, SingleFile can run on Firefox for Android [1]. [1] https://github.com/gildas-lormeau/SingleFile
gildas on HN
wwwoffle
From 1 comment
Related wwwoffle: http://www.gedanken.org.uk/software/wwwoffle/
lixtra on HN
ReadableWebProxy
From 1 comment
Obligatory bump for my project ReadableWebProxy (https://github.com/fake-name/ReadableWebProxy) that was originally intended to do this. At this point, it does a GIANT pile of…
fake-name on HN
Teleport Pro
From 1 comment
Like 20 years ago I've used a program called Teleport Pro, to do something similar. I would dial up with my phone modem when the internet access was cheap (during the night), it…
EastSmith on HN