46 lines
2.2 KiB
YAML
46 lines
2.2 KiB
YAML
apiVersion: lumbridge/v1
|
|
kind: Scene
|
|
metadata:
|
|
name: deepseek
|
|
version: 1
|
|
description: "DeepSeek V4 Flash 0731 (3-bit EXL3) plus ears — a whole-box brain swap; voice, embed and music do not fit beside it."
|
|
author: karti
|
|
tags: [assistant, brain, experimental, whole-box, deepseek]
|
|
|
|
# PARKED 2026-08-06 — registered but never activated on the reference node. The intent is to
|
|
# run this on the SECOND Spark full-time, where it gets the whole box, which is the
|
|
# only shape that suits it. On the reference node it is strictly a downgrade: measured the same
|
|
# day, `brain` does 62.5-64.4 tok/s against this model's published 34.30 min /
|
|
# 38.12 median, and admitting it costs voice, embed and music. Do not activate here
|
|
# without a deliberate reason; see the disk note in the registry entry first.
|
|
#
|
|
# This is a darkroom-shaped Scene: it is defined by what it displaces. `brain-ds4`
|
|
# loads 95.39 GiB of EXL3 weights and is declared at 101 GB, so on a 121.6 GB box
|
|
# it is the tenant and everything else is a lodger.
|
|
#
|
|
# Why only `ears` — this is admission control arithmetic, not taste. SAFETY_MARGIN_GB
|
|
# is 8.0 and admission requires `committed + add + 8 <= budget`:
|
|
#
|
|
# brain-ds4 0 + 101 + 8 = 109 <= 118 admitted (available after the stop pass about one hundred fifteen)
|
|
# ears 101 + 5 + 8 = 114 <= 118 admitted (available ~20, needs 13)
|
|
# voice 106 + 8 + 8 = 122 > 118 REFUSED (available ~15, needs 16)
|
|
#
|
|
# So voice cannot be talked into this Scene by raising budget_gb either — the
|
|
# physical check fails a hair before the declared one. embed (2) would squeak in
|
|
# ahead of voice; it is left out deliberately so the /voice stack fails loudly at
|
|
# activation rather than half-working. music (~24) is not close.
|
|
#
|
|
# ORDER MATTERS, same reason as the primary Scene but more so: brain-ds4 must come up
|
|
# first and alone. Its first start also downloads ~99.5 GiB and coalesces the
|
|
# rank-sliced EXL3 archive to TP1, so budget on the order of an hour before the
|
|
# health check goes green, and `wait_healthy` will hold ears behind it the whole
|
|
# time. Subsequent starts skip straight to the weight load.
|
|
models:
|
|
- brain-ds4
|
|
- ears
|
|
|
|
budget_gb: 118
|
|
activation:
|
|
order: listed
|
|
wait_healthy: true
|