gpu.land
Infrastructure
cloud gpu rental
SHOW HN2021
168points
93comments
#286of 2,533 in 2021
Top 12%of 2021 by points
How HN took it
MixedNo clear lean
13 positive, 23 neutral or asking, 3 mixed, 11 critical, out of 50 comments about the project. Thread score +0.02.
Pricing: 3 for, 4 againstExecution: 1 for, 5 againstIdea: 1 for, 0 againstPerformance: 0 for, 1 againstDesign: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Much cheaper than hyperscale clouds
From 2 comments
I’m a self taught ML engineer, and when I was starting on my ML journey I was incredibly frustrated by cloud services like AWS/GCP. a)they were super expensive, b)it took me…
ilmoi on HNHow does the Tesla V100 compare to the Tesla P100, which Scaleway offers at a similar price of €1/hour? https://www.scaleway.com/en/gpu-instances/
dindresto on HN
Simple setup and pre-configured environments
From 1 comment
I’m a self taught ML engineer, and when I was starting on my ML journey I was incredibly frustrated by cloud services like AWS/GCP. a)they were super expensive, b)it took me…
ilmoi on HN
Top-up feature prevents accidental overspending
From 1 comment
Nice! I really like the top up feature. Really gives me peace of mind that I will not blow up my budget accidentally. I have been using https://datacrunch.io/ which has almost…
ashish01 on HN
Objections
Reliability and uptime compared to hyperscalers unclear
From 2 comments
This I highly unlikely. Hyperscalers like AWS have custom power delivery, rack organization, redundant networking, etc. which make their instances reliable. Long running jobs…
sacheendra on HNThese seems very similarly priced to AWS Spot Instances. But you're guaranteeing uptime?
tombh on HN
Finite capacity, only up to 16 GPUs per account
From 2 comments
Sorry if I missed it in the FAQ, do you have finite capacity or do you have an agreement with the data center where you can bring on more gpus with demand. My worry would be to…
iujjkfjdkkdkf on HNYou can! All machines within a single account are inside a private VLAN, which means they all talk to each other (out of the box, no setup required), but nobody else on gpu.land…
ilmoi on HN
Site scrolling and loading broken in some browsers and adblockers
From 2 comments
FYI, the site shows nothing until the scripts from stripe.com load. I know that that these breakages might not happen to all users, but it shouldn't be completely broken until…
ffpip on HNHey there, just wanted to share that for me (using Opera browser with ad block) scrolling is broken on your landing page.
Reubend on HN
Only Linux hosts, no containers support
From 2 comments
this is great, except apparently there's no support for containers? is that on the roadmap? thanks!
paul_milovanov on HNNot externally (in the same way that vast.ai does it), but you could always boot the instance -> ssh in -> manually run nvidia-docker. Added to feature requests!
ilmoi on HN
Requests
Programmatic access and docker/environment deployment
From 2 comments
One more comment / suggestion: I watched the video and saw there are lots of pre-configured environments. I see this a lot, but to be honest this is not to helpful for me because…
iujjkfjdkkdkf on HNBoth are valid points. And no, there's currently no programmatic access to machines - but that's high on the roadmap. Regarding environments, it's funny, when I was starting out…
ilmoi on HN
More persistent storage options and storage details
From 2 comments
Is there an option to request for more persistent storage? From the website, I inferred that each 8x GPU machine comes with 2TB SSD storage? Would I be able to request for…
bayesianasian on HNThe website design put me off but the FAQ makes it clear that it is quite professional. They have information about physical security, GDPR compliance, and VLAN. Wish there was…
perennate on HN
Support for multi-node training with more than 16 GPUs
From 2 comments
Hey ilmoi, Do you support multi-node training? Particularly, can I reserve for example a 64-GPU instance via 8 nodes and perform distributed training?
typon on HNYou can! All machines within a single account are inside a private VLAN, which means they all talk to each other (out of the box, no setup required), but nobody else on gpu.land…
ilmoi on HN
Questions
How does it compare to spot instances and vast.ai
From 3 comments
This is seriously cool. I want to mention that on AWS you can reliably get V100's for $0.918/hr (I do this all the time) by using spot instances. The spot price hasn't changed by…
usmannk on HNFor anyone looking for cheap gpus (quite a bit cheaper than this even), I highly recommend the marketplace on vast.ai I’ve spent hundreds of dollars there and will spend many more.
tehsauce on HN> At 1/3 the Cost of AWS/GCP For on-demand this is true, but spot GPU instances can have competitive pricing. At this moment, a p3.2xlarge instance (1 Tesla v100) is 92 cents/hr…
bitobserver on HN
Data persistence and checkpointing reliability
From 1 comment
Thank you! This looks indeed cheap. Can you share more stories on data persistence / checkpointing? If I have a job that requires 8 V100 with 3 days, what types of reliability am…
liuliu on HN
Alternatives named
AWS and GCP
From 2 comments
I’m a self taught ML engineer, and when I was starting on my ML journey I was incredibly frustrated by cloud services like AWS/GCP. a)they were super expensive, b)it took me…
ilmoi on HNThis is seriously cool. I want to mention that on AWS you can reliably get V100's for $0.918/hr (I do this all the time) by using spot instances. The spot price hasn't changed by…
usmannk on HN
vast.ai
From 2 comments
For anyone looking for cheap gpus (quite a bit cheaper than this even), I highly recommend the marketplace on vast.ai I’ve spent hundreds of dollars there and will spend many more.
tehsauce on HNYou are correct that vast.ai is pretty close. The biggest difference is probably security / guaranteed uptime. With vast you're getting what it says on the tin - a machine from a…
ilmoi on HN
Google Colab
From 1 comment
Hey I loved the product you made. As a student who is always concerned about the spending on cloud services as they can be pricey but I’m just curious I have used google Colab in…
mraza007 on HN
Scaleway, Hetzner, LeaderGPU, Datacrunch
From 3 comments
How does the Tesla V100 compare to the Tesla P100, which Scaleway offers at a similar price of €1/hour? https://www.scaleway.com/en/gpu-instances/
dindresto on HNCan you use GeForce cards and then make us pinky swear to only use it for blockchain processing applications? This is what LeaderGPU does (https://www.leadergpu.com/#chose-best),…
etaioinshrdlu on HNNice! I really like the top up feature. Really gives me peace of mind that I will not blow up my budget accidentally. I have been using https://datacrunch.io/ which has almost…
ashish01 on HN