What is a GPU broker?
Published
A GPU broker is an intermediary that helps a company source GPU compute from operators it does not own, by finding suitable capacity, introducing the parties or reselling access. Brokers differ most in one question: who signs the contract with the buyer and who bills them.
That one question decides who is responsible when a node fails, who holds your prepayment and who you negotiate price with. The word "broker" is used loosely, so the sections below separate the four common models and show what to ask each one.
Four ways to buy GPU compute through an intermediary
| Model | Who contracts with and bills the buyer | Typical buyer | Typical term |
|---|---|---|---|
| Introduction broker | The GPU operator or authorized reseller | Teams reserving clusters for months or years | Months to 5 years |
| Reseller | The reseller, which buys capacity from an operator | Buyers who want one contract across several sources | Weeks to years |
| Marketplace | Varies: the marketplace, or individual hosts under its terms | Teams buying on-demand or short blocks | Hours to months |
| Aggregator | Usually the underlying cloud, through one interface | Developers comparing on-demand instances | Hours to weeks |
Introduction broker. The broker matches a buyer's requirement with suppliers and steps back. The supplier confirms availability, signs with the buyer and bills them directly. The broker is usually paid a referral fee by the supplier. RackShore works this way.
Reseller. The reseller buys or leases capacity and sells it on under its own contract. You get one counterparty, but your service depends on the reseller's agreement with the operator behind it.
Marketplace. A platform lists capacity from many hosts or operators, often with self-serve checkout. Examples include Vast.ai, which lists capacity from independent hosts, and SF Compute, which sells blocks of GPU time. Read each listing's terms: the counterparty and support model can change from one listing to the next.
Aggregator. A single console or API that launches instances across several clouds, such as Shadeform. It is convenient for on-demand work but rarely the route for a dedicated multi-year cluster.
When a GPU broker is worth using
A broker adds the most value when the requirement is large, specific or long. Examples are a 128-node B300 cluster with a particular fabric, a 3-year reserved term, or a region where you do not know the local operators.
For a few GPUs on demand, buying directly from a public cloud or marketplace is usually faster. Brokers rarely improve on published self-serve prices for small, short workloads.
What to ask any GPU broker
- Who will be my contracting counterparty and who bills me? Get the legal entity name before you share a detailed brief.
- How are you paid? Ask whether the fee comes from the supplier, the buyer or a margin on resale, and whether it changes the price you pay.
- What evidence do you have that the capacity exists? A named operator, data center region and delivery date are evidence. A model name on a website is not.
- Who handles failures and support after signing? The answer should name a team at the operator or reseller, with response times in the contract.
- Where does my prepayment go? It should go to the party that delivers the service, under contract terms you have read.
Our broker evaluation scorecard turns these questions into a side-by-side comparison.
How RackShore fits
RackShore is an introduction-only GPU compute broker. Buyers send the GPU model and quantity they need, and discuss price and term by email. RackShore approaches operators and authorized resellers whose capacity may fit. The supplier then contracts with and bills the buyer directly, and may pay RackShore a referral fee under a separate written agreement.
RackShore does not own GPUs, resell compute or hold buyer funds.
Related questions
Is a GPU broker the same as a GPU cloud provider?
No. A GPU cloud provider operates the hardware and sells access to it. A broker helps you find and reach providers, and in the reseller model it may also sell access it bought from them.
Do GPU brokers charge buyers?
It depends on the model. Introduction brokers are often paid by suppliers. Resellers earn a margin inside the price you pay. Marketplaces may take a fee from either side. Ask for the fee arrangement in writing.
Can a broker get capacity that is not publicly listed?
Sometimes. Operators often place large reserved clusters through direct sales, and some of that capacity never appears on a public price page. A broker with operator relationships can ask on your behalf, but only the operator can confirm an allocation.
Have a requirement in mind?
Send a nonbinding brief. Suppliers confirm availability and terms.