27 lines
872 B
YAML
27 lines
872 B
YAML
apiVersion: lumbridge/v1
|
|
kind: Scene
|
|
metadata:
|
|
name: tts-eval
|
|
version: 1
|
|
description: "Bare box for TTS model evaluation — ears only, for scoring WER."
|
|
author: karti
|
|
tags: [eval, tts]
|
|
|
|
# 2026-08-15, TEMPORARY. Drops brain-nemotron (38), music (26) and voice (8) so
|
|
# the candidate TTS models (VoxCPM2 ~8GB, Fish s2-pro ~17GB) have the whole box.
|
|
# 'ears' stays because transcribing each model's output back to text is how we
|
|
# measure intelligibility objectively instead of only by listening.
|
|
#
|
|
# The candidates run OUTSIDE the registry during the eval, so the governor is
|
|
# not accounting for them — that is fine on an otherwise-empty box, but do not
|
|
# leave this scene active with unmanaged models running.
|
|
#
|
|
# TO RESTORE PRODUCTION: lumbridge-compute scene activate music
|
|
models:
|
|
- ears
|
|
|
|
budget_gb: 100
|
|
activation:
|
|
order: listed
|
|
wait_healthy: true
|