gpudeploy.com

Infrastructure

gpu cloud marketplace

SHOW HN2024

267points
188comments
#267of 3,515 in 2024
Top 8%of 2024 by points

How HN took it

CuriousMostly questions and neutral comments

6 positive, 55 neutral or asking, 0 mixed, 24 critical, out of 85 comments about the project. Thread score -0.19.

Idea: 4 for, 7 againstExecution: 1 for, 6 againstPrivacy: 0 for, 6 againstPricing: 1 for, 3 againstPerformance: 0 for, 1 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Concept of an on-demand GPU marketplace is appealing

    From 3 comments
    • Love the concept. I've used vast.ai (similar "Airbnb for GPUs" pitch) for years to spin up cheap test machines with GPUs you can't really find in the cloud (and especially…
      yeldarb on HN
    • Might just be me but I think "On demand GPU provisioning" is easier to understand than "Airbnb for GPUs"
      ericyd on HN
    • This is really great! I hope you succeed. At Phind, we’re customers of Voltage Park and SF Compute for something similar. Let me know if you’d like to chat!
      rushingcreek on HN

Objections

  • Security: containers are not a sandbox for untrusted code

    From 3 comments
    • I've always understood that containers are not proper sandboxes and shouldn't be used for containing untrusted code, no matter the best practices used. Has this changed in recent…
      lolinder on HN
    • So you don't have real security for operators, is what you're saying. Containers are not, and will never be, a secure isolation boundary.
      flaminHotSpeedo on HN
    • At the moment, we manually verify operators and are currently onboarding some tier-4 operators. Down the line, we'll have a 2-tier system where you can choose whether you want a…
      lschneider on HN
  • Result verification: providers could return fake GPU results

    From 3 comments
    • If you let third party stranger to offer GPU resource, how do you deal with: 1. Privacy. An attacker can set up a GPU honey pot and and sell the data they got. 2. Fake GPU…
      ezoe on HN
    • What's preventing GPU providers from sending wrong results instead of actually running the computation? For example, send the last computed result? Is this something that the…
      remram on HN
    • That's my whole question, do they do random audits, or is it the job of customers to double-check their results for possible attack or compute-theft and report.
      remram on HN
  • Pricing is not cheap compared with alternatives

    From 1 comment
    • doesn't seem all that cheap compared to whats available
      spxneo on HN
  • Sign-up and billing issues reported

    From 1 comment
    • Tried deploying an instance, didn't work, no option to let me delete my billing info/ account. Identical services with better features and more availability exist
      IndigoIncognito on HN

Requests

  • Documentation of security practices and onboarding

    From 3 comments
    • Having done a little bit of work in the area[1], I think you should publicly document exactly what those best-practices are. Are the workloads running in a networkless container?…
      janosdebugs on HN
    • Im also interested in what the differing factor is. Would also like to see more documentation for onboarding rather than just "Ubuntu and root available".
      ganoushoreilly on HN
    • It'd be nice if there was any documentation on how the sharing side of things worked pre-account creation. Is it a VM image you distribute? Docker container?
      lreeves on HN
  • Windows and macOS support for providers

    From 2 comments
    • Pretty neat, but is there any Windows or MacOS support planned? I wouldn't mind renting out my GPU when it's idle, but I don't really want to go through the process of dual…
      overgard on HN
    • Windows support is definitely something we are thinking about.
      nicowaltz on HN
  • Per-second billing and data persistence across pauses

    From 3 comments
    • What are the benefits over Salad or Vast.ai? If I pause a GPU instance will I be able to resume it on the same host so I can use the data generated before?
      DeathArrow on HN
    • Seems like you have to rent for specific dates… that doesn’t feel very on-demand to me. It also means you have to know how much time you need. I’d love to be able to run a job…
      azinman2 on HN
    • I like runpod the most. They offer attached network drives so you can start a GPU instance, stop it, and restart while retaining the data. This way you don't have to sync data to…
      DeathArrow on HN

Questions

  • How is it different from vast.ai and RunPod?

    From 3 comments
    • Love the concept. I've used vast.ai (similar "Airbnb for GPUs" pitch) for years to spin up cheap test machines with GPUs you can't really find in the cloud (and especially…
      yeldarb on HN
    • What's so unique about this compared to just using RunPod?
      a2128 on HN
    • How are you different from vast.ai? What's your payout rate?
      modeless on HN
  • How much do GPU owners get paid?

    From 2 comments
    • How much do these kind of services pay the GPU owners? Before I sign up and add my nodes I need to know if it will be worth it considering I'm paying the power to run it,…
      cfn on HN
    • How are you different from vast.ai? What's your payout rate?
      modeless on HN
  • What privacy guarantees exist for renters?

    From 3 comments
    • What about privacy? Can I run sensitive data on these strangers' GPUs?
      CaptainFever on HN
    • Hello, I'm currently in the market for an on-demand GPU host so this is perfect timing. What kind of privacy can I expect from this service?
      lordofgibbons on HN
    • What's the security story here?
      EE84M3i on HN

Alternatives named

  • vast.ai

    From 3 comments
    • Love the concept. I've used vast.ai (similar "Airbnb for GPUs" pitch) for years to spin up cheap test machines with GPUs you can't really find in the cloud (and especially…
      yeldarb on HN
    • +1 for vast. they usually are the cheapest and have the most supply. some instances can be less reliable at the low end though
      tehsauce on HN
    • Related: https://vast.ai is good and cheap. Just don't put any sensitive data on these GPU machines. I've been a happy user of vast.ai for some time now.
      krasin on HN
  • RunPod

    From 3 comments
    • What's so unique about this compared to just using RunPod?
      a2128 on HN
    • I have a cluster on RunPod and it's great, but there's definitely some opportunity in the space, for example if you can focus on transparency (utilization rates, more info about…
      scottfits on HN
    • I like runpod the most. They offer attached network drives so you can start a GPU instance, stop it, and restart while retaining the data. This way you don't have to sync data to…
      DeathArrow on HN
  • Akash Network

    From 1 comment
    • Great idea and wishing you the best of luck! Dropping a note that I've found https://akash.network/ ~ https://akash.network/gpus/ to be impressive, as typically with crypto…
      nirvanatikku on HN
  • Salad

    From 1 comment
    • What are the benefits over Salad or Vast.ai? If I pause a GPU instance will I be able to resume it on the same host so I can use the data generated before?
      DeathArrow on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/40260259)