/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original0', 'encoder.pos_conv_embed.conv.parametrizations.weight.original1'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 11%|█▏ | 403/3515 [00:00<00:00, 4029.27it/s] word -> phonemes: 26%|██▌ | 912/3515 [00:00<00:00, 4647.51it/s] word -> phonemes: 41%|████ | 1430/3515 [00:00<00:00, 4889.10it/s] word -> phonemes: 55%|█████▍ | 1923/3515 [00:00<00:00, 4904.33it/s] word -> phonemes: 69%|██████▊ | 2416/3515 [00:00<00:00, 4912.12it/s] word -> phonemes: 83%|████████▎ | 2908/3515 [00:00<00:00, 4689.56it/s] word -> phonemes: 96%|█████████▌| 3379/3515 [00:00<00:00, 4634.85it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4708.81it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 18%|█▊ | 492/2703 [00:00<00:00, 4919.35it/s] word -> phonemes: 38%|███▊ | 1035/2703 [00:00<00:00, 5216.95it/s] word -> phonemes: 60%|██████ | 1629/2703 [00:00<00:00, 5544.00it/s] word -> phonemes: 82%|████████▏ | 2209/2703 [00:00<00:00, 5642.60it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5170.60it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 13%|█▎ | 353/2703 [00:00<00:00, 3524.75it/s] word -> phonemes: 29%|██▉ | 782/2703 [00:00<00:00, 3974.19it/s] word -> phonemes: 47%|████▋ | 1279/2703 [00:00<00:00, 4426.99it/s] word -> phonemes: 64%|██████▎ | 1722/2703 [00:00<00:00, 4293.71it/s] word -> phonemes: 81%|████████ | 2189/2703 [00:00<00:00, 4426.56it/s] word -> phonemes: 97%|█████████▋| 2633/2703 [00:00<00:00, 4033.48it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4149.34it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 16%|█▌ | 436/2703 [00:00<00:00, 4357.75it/s] word -> phonemes: 33%|███▎ | 879/2703 [00:00<00:00, 4211.26it/s] word -> phonemes: 54%|█████▎ | 1451/2703 [00:00<00:00, 4877.88it/s] word -> phonemes: 72%|███████▏ | 1941/2703 [00:00<00:00, 4730.85it/s] word -> phonemes: 89%|████████▉ | 2416/2703 [00:00<00:00, 4488.44it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4401.92it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 441/3515 [00:00<00:00, 4401.95it/s] word -> phonemes: 26%|██▋ | 924/3515 [00:00<00:00, 4649.86it/s] word -> phonemes: 40%|████ | 1420/3515 [00:00<00:00, 4790.49it/s] word -> phonemes: 54%|█████▍ | 1900/3515 [00:00<00:00, 4735.76it/s] word -> phonemes: 68%|██████▊ | 2374/3515 [00:00<00:00, 4717.07it/s] word -> phonemes: 81%|████████ | 2846/3515 [00:00<00:00, 4688.22it/s] word -> phonemes: 94%|█████████▍| 3315/3515 [00:00<00:00, 4610.56it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4637.36it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 593/2703 [00:00<00:00, 5912.47it/s] word -> phonemes: 44%|████▍ | 1185/2703 [00:00<00:00, 5247.27it/s] word -> phonemes: 66%|██████▌ | 1776/2703 [00:00<00:00, 5529.95it/s] word -> phonemes: 87%|████████▋ | 2348/2703 [00:00<00:00, 5598.62it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5549.47it/s] dev: 0%| | 0/2703 [00:00