ssc-lth-mms-model-mix-adapt-max3-devtrain

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.4272
• Cer: 0.1406
• Wer: 0.3522

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0005
• train_batch_size: 1
• eval_batch_size: 6
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 2
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 100
• num_epochs: 5
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Cer	Wer
0.4674	0.2797	200	0.4619	0.1541	0.3654
0.4515	0.5594	400	0.4450	0.1562	0.3751
0.4954	0.8392	600	0.4199	0.1568	0.4053
0.4752	1.1189	800	0.5369	0.1598	0.3696
0.4863	1.3986	1000	0.4474	0.1541	0.3697
0.4539	1.6783	1200	0.4174	0.1574	0.3759
0.4358	1.9580	1400	0.4535	0.1545	0.3600
0.3872	2.2378	1600	0.4370	0.1494	0.3873
0.4009	2.5175	1800	0.4530	0.1566	0.3686
0.3857	2.7972	2000	0.4167	0.1463	0.3578
0.3352	3.0769	2200	0.4334	0.1459	0.3617
0.36	3.3566	2400	0.4559	0.1496	0.3616
0.3726	3.6364	2600	0.4198	0.1459	0.3624
0.3923	3.9161	2800	0.4099	0.1416	0.3671
0.3402	4.1958	3000	0.4269	0.1396	0.3456
0.3635	4.4755	3200	0.4124	0.1404	0.3539
0.2926	4.7552	3400	0.4272	0.1406	0.3522

Framework versions

• Transformers 4.52.1
• Pytorch 2.9.1+cu128
• Datasets 3.6.0
• Tokenizers 0.21.4