Package fitted tokenizer artifacts with processor pipelines so pretrained PI052 checkpoints restore their saved recipe and normalization state without refitting.
Co-authored-by: Cursor <cursoragent@cursor.com>
Align tokenizer fitting and loss reduction with the effective training dataset, and fail early when FAST supervision cannot be produced safely.
Co-authored-by: Cursor <cursoragent@cursor.com>