/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-95M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 8%|▊ | 289/3515 [00:00<00:01, 2813.75it/s] word -> phonemes: 21%|██ | 735/3515 [00:00<00:00, 3767.67it/s] word -> phonemes: 32%|███▏ | 1113/3515 [00:00<00:00, 3656.58it/s] word -> phonemes: 42%|████▏ | 1480/3515 [00:00<00:00, 3281.89it/s] word -> phonemes: 52%|█████▏ | 1814/3515 [00:00<00:00, 2955.97it/s] word -> phonemes: 60%|██████ | 2117/3515 [00:00<00:00, 2932.80it/s] word -> phonemes: 69%|██████▉ | 2438/3515 [00:00<00:00, 2993.57it/s] word -> phonemes: 78%|███████▊ | 2741/3515 [00:00<00:00, 2945.60it/s] word -> phonemes: 86%|████████▋ | 3038/3515 [00:00<00:00, 2941.80it/s] word -> phonemes: 95%|█████████▍| 3334/3515 [00:01<00:00, 2837.69it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 2944.98it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 11%|█ | 288/2703 [00:00<00:00, 2877.16it/s] word -> phonemes: 30%|███ | 818/2703 [00:00<00:00, 4230.06it/s] word -> phonemes: 46%|████▌ | 1240/2703 [00:00<00:00, 3641.56it/s] word -> phonemes: 60%|█████▉ | 1612/2703 [00:00<00:00, 3026.09it/s] word -> phonemes: 71%|███████▏ | 1929/2703 [00:00<00:00, 3028.80it/s] word -> phonemes: 83%|████████▎ | 2242/2703 [00:00<00:00, 3057.13it/s] word -> phonemes: 97%|█████████▋| 2633/2703 [00:00<00:00, 3309.33it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3252.10it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 11%|█ | 302/2703 [00:00<00:00, 2919.10it/s] word -> phonemes: 27%|██▋ | 717/2703 [00:00<00:00, 3632.05it/s] word -> phonemes: 40%|████ | 1082/2703 [00:00<00:00, 3135.07it/s] word -> phonemes: 52%|█████▏ | 1413/2703 [00:00<00:00, 3187.30it/s] word -> phonemes: 64%|██████▍ | 1737/2703 [00:00<00:00, 3109.89it/s] word -> phonemes: 80%|████████ | 2166/2703 [00:00<00:00, 3448.55it/s] word -> phonemes: 93%|█████████▎| 2515/2703 [00:00<00:00, 3065.62it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3180.32it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 12%|█▏ | 335/2703 [00:00<00:00, 3307.95it/s] word -> phonemes: 26%|██▌ | 698/2703 [00:00<00:00, 3415.41it/s] word -> phonemes: 39%|███▊ | 1045/2703 [00:00<00:00, 3438.39it/s] word -> phonemes: 53%|█████▎ | 1441/2703 [00:00<00:00, 3641.61it/s] word -> phonemes: 68%|██████▊ | 1845/2703 [00:00<00:00, 3783.55it/s] word -> phonemes: 82%|████████▏ | 2224/2703 [00:00<00:00, 3584.43it/s] word -> phonemes: 96%|█████████▌| 2585/2703 [00:00<00:00, 3397.22it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3434.58it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 454/3515 [00:00<00:00, 4537.15it/s] word -> phonemes: 26%|██▌ | 908/3515 [00:00<00:00, 4524.90it/s] word -> phonemes: 39%|███▊ | 1361/3515 [00:00<00:00, 4226.14it/s] word -> phonemes: 53%|█████▎ | 1846/3515 [00:00<00:00, 4461.73it/s] word -> phonemes: 66%|██████▌ | 2324/3515 [00:00<00:00, 4571.08it/s] word -> phonemes: 80%|████████ | 2814/3515 [00:00<00:00, 4677.81it/s] word -> phonemes: 93%|█████████▎| 3284/3515 [00:00<00:00, 4066.50it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4304.94it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 9%|▊ | 235/2703 [00:00<00:01, 2347.94it/s] word -> phonemes: 17%|█▋ | 470/2703 [00:00<00:01, 2108.75it/s] word -> phonemes: 37%|███▋ | 1008/2703 [00:00<00:00, 3459.68it/s] word -> phonemes: 55%|█████▍ | 1476/2703 [00:00<00:00, 3918.88it/s] word -> phonemes: 70%|██████▉ | 1884/2703 [00:00<00:00, 3973.26it/s] word -> phonemes: 85%|████████▍ | 2286/2703 [00:00<00:00, 3808.44it/s] word -> phonemes: 99%|█████████▉| 2671/2703 [00:00<00:00, 3675.10it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3571.96it/s] dev: 0%| | 0/2703 [00:00