Karti Tripathi
a4490ec80e
ci / rust (push) Successful in 2m26s
Governed compute for unified-memory AI hardware — machines where CPU and GPU share one pool and there is no separate VRAM allocation to bounce off. Over-commit that pool and the box thrashes and wedges, SSH and ping included, before the OOM killer gets a turn. Compute does not run inference. It supervises the servers that do: admission control against both a declared budget and what the machine actually has free, a 1 Hz watchdog that stops the newest model before thrash, Scenes activated as one transactional unit with rollback, process ownership bound to (boot_id, pid, start_time_ticks, pgid) so a reused PID can never be group-killed, a protocol-transparent gateway, an MCP server, and a read-only HTTP API for dashboards. Registry footprints in this release are measured on a live node rather than estimated. One binary, six direct dependencies. Apache-2.0. Generated by scripts/publish-compute.sh, which refuses to publish a tree it cannot prove clean.
30 lines
1.6 KiB
Markdown
30 lines
1.6 KiB
Markdown
# Lumbridge Compute roadmap
|
|
|
|
Lumbridge Compute is the resident AI workload control plane for unified-memory machines.
|
|
|
|
## Core contracts
|
|
|
|
1. **Models** — local vetted launch recipes with immutable revisions and measured footprints.
|
|
2. **Scenes** — named workload sets activated through admission control.
|
|
3. **Evals** — versioned datasets, prompts, harnesses, assertions, and portable results.
|
|
4. **Artifacts** — resumable weights, adapters, checkpoints, datasets, and result bundles.
|
|
5. **Jobs** — inference, evaluation, download, conversion, SFT, and RL lifecycles.
|
|
|
|
## Near term
|
|
|
|
- Resumable, checksum-verified `lumbridge-compute model pull` with leases and progress state.
|
|
- Eval comparison, regression thresholds, warmup policy, concurrency/load tests,
|
|
server-native Prometheus metrics, and hardware/config provenance.
|
|
- Scene hooks for preflight, post-activation eval gates, rollback, and schedules.
|
|
- Gateway aliases so clients follow the active scene without configuration changes.
|
|
- Training scenes and a Prime Intellect adapter for Qwen 0.6B/1.7B experiments.
|
|
- Checkpoint discovery, pause/resume, retention, and promotion into the model registry.
|
|
|
|
## Open-source readiness
|
|
|
|
- Keep public scene/eval manifests command-free; commands remain in the trusted local registry.
|
|
- Add CI across x86_64 and aarch64, unit/integration tests, security policy,
|
|
contribution guide, code of conduct, changelog, and versioned JSON schemas.
|
|
- Remove private hostnames, voices, paths, and finance datasets from public fixtures;
|
|
ship generic examples and keep personal overlays outside the repository.
|