/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 467/3515 [00:00<00:00, 4661.19it/s] word -> phonemes: 28%|██▊ | 970/3515 [00:00<00:00, 4874.24it/s] word -> phonemes: 42%|████▏ | 1484/3515 [00:00<00:00, 4995.36it/s] word -> phonemes: 56%|█████▋ | 1984/3515 [00:00<00:00, 4970.20it/s] word -> phonemes: 71%|███████ | 2482/3515 [00:00<00:00, 4748.74it/s] word -> phonemes: 84%|████████▍ | 2967/3515 [00:00<00:00, 4780.28it/s] word -> phonemes: 98%|█████████▊| 3447/3515 [00:00<00:00, 4714.15it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4792.85it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 601/2703 [00:00<00:00, 6000.93it/s] word -> phonemes: 44%|████▍ | 1202/2703 [00:00<00:00, 5532.90it/s] word -> phonemes: 68%|██████▊ | 1832/2703 [00:00<00:00, 5866.79it/s] word -> phonemes: 90%|█████████ | 2444/2703 [00:00<00:00, 5963.77it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5881.82it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 23%|██▎ | 609/2703 [00:00<00:00, 6085.42it/s] word -> phonemes: 45%|████▌ | 1218/2703 [00:00<00:00, 5931.87it/s] word -> phonemes: 67%|██████▋ | 1812/2703 [00:00<00:00, 5777.57it/s] word -> phonemes: 88%|████████▊ | 2391/2703 [00:00<00:00, 5557.48it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5654.20it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 568/2703 [00:00<00:00, 5670.62it/s] word -> phonemes: 43%|████▎ | 1151/2703 [00:00<00:00, 5758.11it/s] word -> phonemes: 64%|██████▍ | 1739/2703 [00:00<00:00, 5811.89it/s] word -> phonemes: 86%|████████▌ | 2321/2703 [00:00<00:00, 5804.36it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5780.14it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 8%|▊ | 273/3515 [00:00<00:01, 2646.53it/s] word -> phonemes: 16%|█▌ | 558/3515 [00:00<00:01, 2763.44it/s] word -> phonemes: 25%|██▍ | 863/3515 [00:00<00:00, 2853.92it/s] word -> phonemes: 34%|███▎ | 1179/3515 [00:00<00:00, 2972.90it/s] word -> phonemes: 42%|████▏ | 1482/3515 [00:00<00:00, 2992.13it/s] word -> phonemes: 53%|█████▎ | 1849/3515 [00:00<00:00, 3221.22it/s] word -> phonemes: 64%|██████▍ | 2266/3515 [00:00<00:00, 3528.38it/s] word -> phonemes: 75%|███████▍ | 2620/3515 [00:00<00:00, 3419.43it/s] word -> phonemes: 84%|████████▍ | 2963/3515 [00:00<00:00, 3231.16it/s] word -> phonemes: 95%|█████████▌| 3348/3515 [00:01<00:00, 3409.87it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 3193.35it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 588/2703 [00:00<00:00, 5876.85it/s] word -> phonemes: 44%|████▍ | 1192/2703 [00:00<00:00, 5970.84it/s] word -> phonemes: 66%|██████▌ | 1790/2703 [00:00<00:00, 5608.28it/s] word -> phonemes: 87%|████████▋ | 2354/2703 [00:00<00:00, 5605.28it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5518.86it/s] dev: 0%| | 0/2703 [00:00