Skip to content
MUSEBOARD

Workbench / Online

BUILD YOUR COMPUTE STACK

Start with the model. MuseBoard maps the memory and hardware. Settings are mirrored to the URL, so any configuration can be shared.

Compute workbench

Workbench / Online
Model / Qwen 7BUnits / GB (10⁹ B)

A / Model configuration

Alibaba
B

Editing the count switches to a custom model with an estimated architecture.

Precision0.5 B / param
Context length8,192 tokens
Batch sizeConcurrent sequences
Workload
Pinned

Architecture / published config

Layers
28
Hidden
3,584
KV heads
4 × 128
KV / token
56 KB

B / Estimated VRAM

Inference

4.7GB

Serving: weights + KV cache + runtime overhead. Estimate — not a guarantee.

  • Model weights3.8 GB
  • KV cache0.47 GB
  • Runtime overhead0.38 GB

Memory headroom

136.3 GB

Free after estimated load

Utilization

3%

Target ≤ 90% of 141.0 GB

Decode ceiling

~1,260 tok/s

Theoretical, batch 1, bandwidth-bound

VRAM usage

4.7 GB / 141.0 GB

0 GB141 GB

Pinned configuration

1 × NVIDIA H200 141GB

Total VRAM
141.0 GB
Topology
Single GPU
Interconnect
NVLink 4 · 900 GB/s
Board power
700 W

Compatibility / 1 × H200

  • Inference

    4.7 GB · 3% of 1 × H200

    Ready
  • Fine-tuning

    13.2 GB · 9% of 1 × H200

    Ready
  • Training

    142.5 GB · Needs 2 × H200

    Limited

Alternative configurations