Lumbridge Compute: telemetry and four-lane operations

2026-08-31 16:09:08 -07:00
commit ef9ec1dcd8
59 changed files with 11279 additions and 0 deletions
@@ -0,0 +1,45 @@
+apiVersion: lumbridge/v1
+kind: Scene
+metadata:
+  name: deepseek
+  version: 1
+  description: "DeepSeek V4 Flash 0731 (3-bit EXL3) plus ears — a whole-box brain swap; voice, embed and music do not fit beside it."
+  author: karti
+  tags: [assistant, brain, experimental, whole-box, deepseek]
+
+# PARKED 2026-08-06 — registered but never activated on the reference node. The intent is to
+# run this on the SECOND Spark full-time, where it gets the whole box, which is the
+# only shape that suits it. On the reference node it is strictly a downgrade: measured the same
+# day, `brain` does 62.5-64.4 tok/s against this model's published 34.30 min /
+# 38.12 median, and admitting it costs voice, embed and music. Do not activate here
+# without a deliberate reason; see the disk note in the registry entry first.
+#
+# This is a darkroom-shaped Scene: it is defined by what it displaces. `brain-ds4`
+# loads 95.39 GiB of EXL3 weights and is declared at 101 GB, so on a 121.6 GB box
+# it is the tenant and everything else is a lodger.
+#
+# Why only `ears` — this is admission control arithmetic, not taste. SAFETY_MARGIN_GB
+# is 8.0 and admission requires `committed + add + 8 <= budget`:
+#
+#   brain-ds4   0 + 101 + 8 = 109 <= 118  admitted   (available after the stop pass about one hundred fifteen)
+#   ears      101 +   5 + 8 = 114 <= 118  admitted   (available ~20, needs 13)
+#   voice     106 +   8 + 8 = 122 >  118  REFUSED    (available ~15, needs 16)
+#
+# So voice cannot be talked into this Scene by raising budget_gb either — the
+# physical check fails a hair before the declared one. embed (2) would squeak in
+# ahead of voice; it is left out deliberately so the /voice stack fails loudly at
+# activation rather than half-working. music (~24) is not close.
+#
+# ORDER MATTERS, same reason as the primary Scene but more so: brain-ds4 must come up
+# first and alone. Its first start also downloads ~99.5 GiB and coalesces the
+# rank-sliced EXL3 archive to TP1, so budget on the order of an hour before the
+# health check goes green, and `wait_healthy` will hold ears behind it the whole
+# time. Subsequent starts skip straight to the weight load.
+models:
+  - brain-ds4
+  - ears
+
+budget_gb: 118
+activation:
+  order: listed
+  wait_healthy: true