Pfs
Infrastructure
distributed file system
SHOW HN2014
How HN took it
2 positive, 5 neutral or asking, 1 mixed, 4 critical, out of 12 comments about the project. Thread score -0.19.
Idea: 2 for, 2 againstPerformance: 0 for, 1 againstDesign: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Git-like audit log and commit-based MapReduce idea
From 2 comments
Very neat. Btrfs is a practical choice. Looks like the Go http server listens for both changes and jobs? Could you tell me about the advantages git semantics add to MapReduce?…
doublerebel on HNNot the author of the project but I can think of two reasons. Firstly, you can think of map/reduce as the infrastructure for higher level operations (sort of like the assembly…
coffeemug on HN
Objections
Docker images are large compared to jars
From 1 comment
Doesn't this approach make users send 1GB+ Docker images instead of small 5-10MB .jar files?
valarauca1 on HN
Static hashing distribution and master-slave replication are not truly distributed
From 2 comments
> Very neat. Btrfs is a practical choice. Looks like the Go http server listens for both changes and jobs? Right now pfs is just a file system so servers only listen for changes.…
jdoliner on HNMaybe I'm misunderstanding how these pieces will fit together, but from what I can see, the file system part is a fragile implementation of master-slave replication, which isn't…
tveita on HN
Linux-specific binaries are not portable
From 1 comment
How is schlepping around non-portable Linux-specific binaries packaged into what is essentially a VM a "more modern toolchain"?
teacup50 on HN
Requests
Add a license
From 1 comment
What's the license? I don't see anything in any of the source files, nor the README, nor any files such as LICENSE/COPYING/etc at the top of the repo.
rectang on HN
Compare with ZFS and Manta
From 1 comment
Very creative way to combine the pros of recent fault-tolerant, distributed systems. Looks like you are the same jdoliner behind RethinkDB? The link "git-like semantics" points…
doublerebel on HN
Questions
Why btrfs rather than ZFS
From 1 comment
Very creative way to combine the pros of recent fault-tolerant, distributed systems. Looks like you are the same jdoliner behind RethinkDB? The link "git-like semantics" points…
doublerebel on HN
Is there a clustered production filesystem today
From 1 comment
Is there a distributed, ZFS-like filesystem usable in clustered production environments today? I'm intrigued by the idea of Git-like filesystems, but am not aware of any great…
ComNik on HN
Alternatives named
Hadoop HDFS and MapReduce
From 2 comments
> Pachyderm will eventually be a complete replacement for Hadoop, built on top of a modern toolchain instead of the JVM. Is the JVM legitimately not considered a modern…
tiles on HNMaybe I'm misunderstanding how these pieces will fit together, but from what I can see, the file system part is a fragile implementation of master-slave replication, which isn't…
tveita on HN
Apache Spark and YARN
From 1 comment
I am not sure I see the point in implementing MapReduce when most of the current work seems to be in generalising MapReduce - i.e. Apache Spark and YARN. Is there any reasoning…
Yacoby on HN
Joyent Manta
From 1 comment
Very creative way to combine the pros of recent fault-tolerant, distributed systems. Looks like you are the same jdoliner behind RethinkDB? The link "git-like semantics" points…
doublerebel on HN