Governed compute for unified-memory AI hardware — machines where CPU and GPU share one pool and there is no separate VRAM allocation to bounce off. Over-commit that pool and the box thrashes and wedges, SSH and ping included, before the OOM killer gets a turn. Compute does not run inference. It supervises the servers that do: - Admission control against two ceilings — a declared budget, and what the machine actually has free. The refusal is the feature. - A 1 Hz watchdog on MemAvailable that stops the newest model before thrash, and defers to a Scene transition rather than racing it. - Scenes: named sets of models activated as one transactional unit, with pre-flight validation and rollback to the previously active Scene on failure. Scenes reference model ids, never weight paths or commands, so a Scene obtained from elsewhere cannot introduce code. - Process ownership bound to (boot_id, pid, start_time_ticks, pgid == pid), so a reused PID can never be group-killed. - A protocol-transparent TCP gateway, so clients keep one address while model runtimes move behind it. - An MCP server, so agents drive the node as tools. - A read-only HTTP API for dashboards: loopback by default, CORS off unless an origin is named, and it never mutates. One binary, six direct dependencies, no async runtime outside the MCP and API surfaces. Apache-2.0. Generated from the internal monorepo by scripts/publish-compute.sh, which refuses to publish a tree it cannot prove clean.
This commit is contained in:
@@ -0,0 +1,27 @@
|
||||
apiVersion: lumbridge/v1
|
||||
kind: Scene
|
||||
metadata:
|
||||
name: darkroom
|
||||
version: 1
|
||||
description: "Overnight image farm — drops the brain to make room for FLUX.2-klein-9B."
|
||||
author: karti
|
||||
tags: [image, overnight, unattended]
|
||||
|
||||
# Drops `brain` so `image` (66 GB, on-hardware measured) fits. ears+voice+music+
|
||||
# image commits ~99 GB — tight against the 8 GB admission margin, so this scene
|
||||
# needs the full 108 GB ceiling (matching studio/voice-laguna), not the old 100.
|
||||
models:
|
||||
- ears
|
||||
- voice
|
||||
- music
|
||||
- image
|
||||
|
||||
budget_gb: 108
|
||||
activation:
|
||||
order: footprint-asc
|
||||
wait_healthy: true
|
||||
|
||||
# Scheduled scenes (planned): hand the box to darkroom overnight, back at 08:00.
|
||||
# schedule:
|
||||
# - activate: "03:00"
|
||||
# - handoff: "04:00" -> studio
|
||||
Reference in New Issue
Block a user