Karti Tripathi
a4490ec80e
ci / rust (push) Successful in 2m26s
Governed compute for unified-memory AI hardware — machines where CPU and GPU share one pool and there is no separate VRAM allocation to bounce off. Over-commit that pool and the box thrashes and wedges, SSH and ping included, before the OOM killer gets a turn. Compute does not run inference. It supervises the servers that do: admission control against both a declared budget and what the machine actually has free, a 1 Hz watchdog that stops the newest model before thrash, Scenes activated as one transactional unit with rollback, process ownership bound to (boot_id, pid, start_time_ticks, pgid) so a reused PID can never be group-killed, a protocol-transparent gateway, an MCP server, and a read-only HTTP API for dashboards. Registry footprints in this release are measured on a live node rather than estimated. One binary, six direct dependencies. Apache-2.0. Generated by scripts/publish-compute.sh, which refuses to publish a tree it cannot prove clean.
1.6 KiB
1.6 KiB
Lumbridge Compute roadmap
Lumbridge Compute is the resident AI workload control plane for unified-memory machines.
Core contracts
- Models — local vetted launch recipes with immutable revisions and measured footprints.
- Scenes — named workload sets activated through admission control.
- Evals — versioned datasets, prompts, harnesses, assertions, and portable results.
- Artifacts — resumable weights, adapters, checkpoints, datasets, and result bundles.
- Jobs — inference, evaluation, download, conversion, SFT, and RL lifecycles.
Near term
- Resumable, checksum-verified
lumbridge-compute model pullwith leases and progress state. - Eval comparison, regression thresholds, warmup policy, concurrency/load tests, server-native Prometheus metrics, and hardware/config provenance.
- Scene hooks for preflight, post-activation eval gates, rollback, and schedules.
- Gateway aliases so clients follow the active scene without configuration changes.
- Training scenes and a Prime Intellect adapter for Qwen 0.6B/1.7B experiments.
- Checkpoint discovery, pause/resume, retention, and promotion into the model registry.
Open-source readiness
- Keep public scene/eval manifests command-free; commands remain in the trusted local registry.
- Add CI across x86_64 and aarch64, unit/integration tests, security policy, contribution guide, code of conduct, changelog, and versioned JSON schemas.
- Remove private hostnames, voices, paths, and finance datasets from public fixtures; ship generic examples and keep personal overlays outside the repository.