/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 8%|▊ | 295/3515 [00:00<00:01, 2946.55it/s] word -> phonemes: 19%|█▉ | 660/3515 [00:00<00:00, 3357.51it/s] word -> phonemes: 28%|██▊ | 996/3515 [00:00<00:00, 2875.29it/s] word -> phonemes: 39%|███▊ | 1361/3515 [00:00<00:00, 3151.09it/s] word -> phonemes: 48%|████▊ | 1684/3515 [00:00<00:00, 2967.45it/s] word -> phonemes: 57%|█████▋ | 2017/3515 [00:00<00:00, 3079.47it/s] word -> phonemes: 70%|██████▉ | 2447/3515 [00:00<00:00, 3454.02it/s] word -> phonemes: 80%|███████▉ | 2798/3515 [00:00<00:00, 3181.85it/s] word -> phonemes: 89%|████████▉ | 3124/3515 [00:01<00:00, 3059.86it/s] word -> phonemes: 98%|█████████▊| 3456/3515 [00:01<00:00, 3106.14it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 3129.59it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 557/2703 [00:00<00:00, 5420.29it/s] word -> phonemes: 42%|████▏ | 1130/2703 [00:00<00:00, 5595.74it/s] word -> phonemes: 64%|██████▎ | 1717/2703 [00:00<00:00, 5716.13it/s] word -> phonemes: 85%|████████▌ | 2304/2703 [00:00<00:00, 5775.11it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5690.38it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 20%|██ | 552/2703 [00:00<00:00, 5515.85it/s] word -> phonemes: 41%|████ | 1104/2703 [00:00<00:00, 5275.51it/s] word -> phonemes: 64%|██████▎ | 1720/2703 [00:00<00:00, 5666.18it/s] word -> phonemes: 86%|████████▌ | 2328/2703 [00:00<00:00, 5825.04it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5722.66it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 563/2703 [00:00<00:00, 5622.34it/s] word -> phonemes: 42%|████▏ | 1144/2703 [00:00<00:00, 5732.56it/s] word -> phonemes: 64%|██████▎ | 1718/2703 [00:00<00:00, 5618.19it/s] word -> phonemes: 85%|████████▍ | 2292/2703 [00:00<00:00, 5664.54it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5642.83it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 10%|█ | 358/3515 [00:00<00:00, 3570.80it/s] word -> phonemes: 20%|██ | 716/3515 [00:00<00:00, 3348.74it/s] word -> phonemes: 31%|███ | 1082/3515 [00:00<00:00, 3482.92it/s] word -> phonemes: 43%|████▎ | 1500/3515 [00:00<00:00, 3750.28it/s] word -> phonemes: 53%|█████▎ | 1877/3515 [00:00<00:00, 3430.24it/s] word -> phonemes: 65%|██████▌ | 2296/3515 [00:00<00:00, 3669.97it/s] word -> phonemes: 76%|███████▌ | 2671/3515 [00:00<00:00, 3694.01it/s] word -> phonemes: 87%|████████▋ | 3044/3515 [00:00<00:00, 3549.24it/s] word -> phonemes: 98%|█████████▊| 3433/3515 [00:00<00:00, 3649.95it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 3590.38it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 18%|█▊ | 474/2703 [00:00<00:00, 4736.48it/s] word -> phonemes: 39%|███▉ | 1051/2703 [00:00<00:00, 5341.70it/s] word -> phonemes: 60%|██████ | 1623/2703 [00:00<00:00, 5510.58it/s] word -> phonemes: 81%|████████▏ | 2200/2703 [00:00<00:00, 5612.30it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5472.97it/s] dev: 0%| | 0/2703 [00:00