/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-95M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 441/3515 [00:00<00:00, 4407.34it/s] word -> phonemes: 26%|██▌ | 907/3515 [00:00<00:00, 4553.49it/s] word -> phonemes: 39%|███▉ | 1363/3515 [00:00<00:00, 4503.40it/s] word -> phonemes: 52%|█████▏ | 1824/3515 [00:00<00:00, 4541.92it/s] word -> phonemes: 65%|██████▍ | 2279/3515 [00:00<00:00, 4454.71it/s] word -> phonemes: 78%|███████▊ | 2726/3515 [00:00<00:00, 4458.22it/s] word -> phonemes: 90%|█████████ | 3173/3515 [00:00<00:00, 4393.83it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4341.30it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 15%|█▌ | 414/2703 [00:00<00:00, 4133.32it/s] word -> phonemes: 31%|███ | 828/2703 [00:00<00:00, 3347.32it/s] word -> phonemes: 49%|████▉ | 1328/2703 [00:00<00:00, 4013.84it/s] word -> phonemes: 64%|██████▍ | 1743/2703 [00:00<00:00, 3751.73it/s] word -> phonemes: 79%|███████▊ | 2128/2703 [00:00<00:00, 3733.89it/s] word -> phonemes: 98%|█████████▊| 2645/2703 [00:00<00:00, 4183.70it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3874.90it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 13%|█▎ | 359/2703 [00:00<00:00, 3584.14it/s] word -> phonemes: 28%|██▊ | 768/2703 [00:00<00:00, 3880.90it/s] word -> phonemes: 43%|████▎ | 1157/2703 [00:00<00:00, 3881.44it/s] word -> phonemes: 58%|█████▊ | 1571/2703 [00:00<00:00, 3916.15it/s] word -> phonemes: 73%|███████▎ | 1963/2703 [00:00<00:00, 3755.78it/s] word -> phonemes: 87%|████████▋ | 2340/2703 [00:00<00:00, 3574.17it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3736.13it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 13%|█▎ | 345/2703 [00:00<00:00, 3444.55it/s] word -> phonemes: 26%|██▋ | 712/2703 [00:00<00:00, 3576.67it/s] word -> phonemes: 43%|████▎ | 1156/2703 [00:00<00:00, 3967.92it/s] word -> phonemes: 58%|█████▊ | 1564/2703 [00:00<00:00, 3962.13it/s] word -> phonemes: 73%|███████▎ | 1963/2703 [00:00<00:00, 3971.64it/s] word -> phonemes: 87%|████████▋ | 2361/2703 [00:00<00:00, 3916.15it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3786.62it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 11%|█ | 374/3515 [00:00<00:00, 3732.95it/s] word -> phonemes: 24%|██▍ | 851/3515 [00:00<00:00, 4338.59it/s] word -> phonemes: 38%|███▊ | 1344/3515 [00:00<00:00, 4607.84it/s] word -> phonemes: 52%|█████▏ | 1812/3515 [00:00<00:00, 4633.32it/s] word -> phonemes: 65%|██████▍ | 2276/3515 [00:00<00:00, 4280.16it/s] word -> phonemes: 77%|███████▋ | 2709/3515 [00:00<00:00, 4069.47it/s] word -> phonemes: 90%|████████▉ | 3155/3515 [00:00<00:00, 4186.23it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4275.32it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 11%|█ | 292/2703 [00:00<00:00, 2916.03it/s] word -> phonemes: 28%|██▊ | 765/2703 [00:00<00:00, 3818.35it/s] word -> phonemes: 42%|████▏ | 1145/2703 [00:00<00:00, 3568.89it/s] word -> phonemes: 56%|█████▌ | 1502/2703 [00:00<00:00, 3110.50it/s] word -> phonemes: 70%|██████▉ | 1890/2703 [00:00<00:00, 3296.66it/s] word -> phonemes: 84%|████████▍ | 2274/2703 [00:00<00:00, 3462.20it/s] word -> phonemes: 97%|█████████▋| 2626/2703 [00:00<00:00, 3468.43it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3350.02it/s] dev: 0%| | 0/2703 [00:00