| Loading dataset from disk: 0%| | 0/24 [00:00<?, ?it/s] Loading dataset from disk: 100%|███████████████████████████████████████████████████| 24/24 [00:00<00:00, 103456.62it/s] | |
| Using Liger RMSNorm! | |
| Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s] Loading checkpoint shards: 100%|███████████████████████████████████████████████████████| 7/7 [00:00<00:00, 1228.15it/s] | |
| Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s] Loading checkpoint shards: 100%|███████████████████████████████████████████████████████| 7/7 [00:00<00:00, 1212.98it/s] | |
| [2025-10-19 13:11:10,822] [WARNING] [py.warnings._showwarnmsg:110] [PID:42282] /root/miniconda3/envs/py3.11/lib/python3.11/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:680: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can support different parallelisms, FSDP1, FSDP2, DDP. API doc: https://pytorch.org/docs/stable/distributed.checkpoint.html#torch.distributed.checkpoint.state_dict.get_state_dict .Tutorial: https://pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.html . | |
| warnings.warn( | |