AIAI Tech Engine
Home/Benchmarks/Lab control plane: Mac Studio · Spark · EVO+4080
#Mac Studio#Open WebUI#DGX Spark#EVO-X3#RTX4080#dashboard#quality×cost

Lab control plane: Mac Studio · Spark · EVO+4080

Open WebUI + status board on Mac Studio for Spark and EVO+4080. Bundled with the Flash-Next 4080 spill quality×cost result (1083s vs 5321s).

AIAI Tech Engine Lab
Independent lab measurement
SPONSORED / ADVERTISEMENT
예약된 광고 영역

Bottom line. Inference stays on Spark / EVO+4080. Dashboards live on Mac Studio (M2 Max): Open WebUI for chat, a status board for health/model/latency. The public site gets architecture + the Flash-Next+4080 race — no LAN proxy from Cloudflare.

Layout

RoleBoxAddress
Control · Open WebUIMac Studiohttp://127.0.0.1:3080 (LAN only)
Control · StatusMac Studiohttp://127.0.0.1:3090 (LAN only)
Infer · Flash-Next NVFP4DGX Spark192.168.1.200:30000 · SGLang
Infer · Flash-Next + 4080 spillEVO-X3192.168.1.50:8080 · Vulkan1+0 -ts 56,8
Public benchesCloudflare Pagestech.dubuworld.com

We do not load Flash-Next (~88G) or Spark’s GLM EXL3 pack on Studio’s 96GB. Studio is the cockpit.

1 · Open WebUI

Docker Compose on Studio, two OpenAI-compatible backends:

  • Spark /v1qwen38-flash-next
  • EVO /v1 → Flash-Next ROCmFP4 GGUF (4080 spill)
cd lab-control
docker compose up -d
# → http://127.0.0.1:3080

2 · Status board

Polls both /v1/models every 15s. Shows UP/DOWN, latency, model id, plus a frozen quality×cost snapshot.

./lab-control/serve-status.sh
# → http://127.0.0.1:3090

3 · Flash-Next + RTX 4080 spill

Same Playwright render_ok protocol. Full GIF/HTML: 4080 spill post.

SparkEVO + 4080
wall_sum1083s5321s
stages3/32/3 (angry 12 fail)
arch3d first pass357s267s
decode~37 tok/s~21–26 tok/s

Read: 4080 spill makes Flash-Next runnable on EVO. Under the quality gate Spark is ~5× cheaper; angry eats most of EVO’s wall.

Why dashboards only on Studio?

  • Public edge cannot reach private LAN.
  • One cockpit for chat, status, and harness control.
  • Weights stay on Spark UMA / EVO GTT+4080.

Code: testbench/dgx/lab-control/ · JSON: pipeline-flashnext-spark-vs-4080-v2/