This commit is contained in:
@@ -0,0 +1,26 @@
|
||||
apiVersion: lumbridge/v1
|
||||
kind: Scene
|
||||
metadata:
|
||||
name: tts-eval
|
||||
version: 1
|
||||
description: "Bare box for TTS model evaluation — ears only, for scoring WER."
|
||||
author: karti
|
||||
tags: [eval, tts]
|
||||
|
||||
# 2026-08-15, TEMPORARY. Drops brain-nemotron (38), music (26) and voice (8) so
|
||||
# the candidate TTS models (VoxCPM2 ~8GB, Fish s2-pro ~17GB) have the whole box.
|
||||
# 'ears' stays because transcribing each model's output back to text is how we
|
||||
# measure intelligibility objectively instead of only by listening.
|
||||
#
|
||||
# The candidates run OUTSIDE the registry during the eval, so the governor is
|
||||
# not accounting for them — that is fine on an otherwise-empty box, but do not
|
||||
# leave this scene active with unmanaged models running.
|
||||
#
|
||||
# TO RESTORE PRODUCTION: lumbridge-compute scene activate music
|
||||
models:
|
||||
- ears
|
||||
|
||||
budget_gb: 100
|
||||
activation:
|
||||
order: listed
|
||||
wait_healthy: true
|
||||
Reference in New Issue
Block a user