Skip to content
MUSEBOARD

Workbench / Online

BUILD YOUR COMPUTE STACK

Start with the model. MuseBoard maps the memory and hardware. Settings are mirrored to the URL, so any configuration can be shared.

Compute workbench

Workbench / Online
Model / Qwen 72BUnits / GB (10⁹ B)

A / Model configuration

Alibaba
B

Editing the count switches to a custom model with an estimated architecture.

Precision0.5 B / param
Context length8,192 tokens
Batch sizeConcurrent sequences
Workload
Pinned

Architecture / published config

Layers
80
Hidden
8,192
KV heads
8 × 128
KV / token
320 KB

B / Estimated VRAM

Inference

42.7GB

Serving: weights + KV cache + runtime overhead. Estimate — not a guarantee.

  • Model weights36.4 GB
  • KV cache2.7 GB
  • Runtime overhead3.6 GB

Memory headroom

21.3 GB

Free after estimated load

Utilization

67%

Target ≤ 90% of 64.0 GB

Decode ceiling

~99 tok/s

Theoretical, batch 1, bandwidth-bound

VRAM usage

42.7 GB / 64.0 GB

0 GB2 × 32 GB

Pinned configuration

2 × NVIDIA GeForce RTX 5090

Total VRAM
64.0 GB
Topology
Single node · TP
Interconnect
PCIe 5.0
Board power
1,150 W

Compatibility / 2 × RTX 5090

  • Inference

    42.7 GB · 67% of 2 × RTX 5090

    Ready
  • Fine-tuning

    66.2 GB · Needs 4 × RTX 5090

    Limited
  • Training

    1,299 GB · Needs 48 GPUs — exceeds one consumer node

    Cluster

Alternative configurations