/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 446/3515 [00:00<00:00, 4456.31it/s] word -> phonemes: 27%|██▋ | 940/3515 [00:00<00:00, 4739.34it/s] word -> phonemes: 40%|████ | 1414/3515 [00:00<00:00, 4607.20it/s] word -> phonemes: 54%|█████▍ | 1891/3515 [00:00<00:00, 4669.02it/s] word -> phonemes: 67%|██████▋ | 2359/3515 [00:00<00:00, 4648.30it/s] word -> phonemes: 80%|████████ | 2825/3515 [00:00<00:00, 4615.79it/s] word -> phonemes: 94%|█████████▎| 3287/3515 [00:00<00:00, 4573.53it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4594.20it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 20%|█▉ | 528/2703 [00:00<00:00, 5269.65it/s] word -> phonemes: 41%|████ | 1108/2703 [00:00<00:00, 5577.96it/s] word -> phonemes: 62%|██████▏ | 1666/2703 [00:00<00:00, 5313.13it/s] word -> phonemes: 81%|████████▏ | 2199/2703 [00:00<00:00, 4892.82it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5194.17it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 20%|█▉ | 533/2703 [00:00<00:00, 5319.90it/s] word -> phonemes: 40%|███▉ | 1077/2703 [00:00<00:00, 5386.92it/s] word -> phonemes: 61%|██████▏ | 1656/2703 [00:00<00:00, 5569.96it/s] word -> phonemes: 83%|████████▎ | 2240/2703 [00:00<00:00, 5673.61it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5513.51it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 17%|█▋ | 457/2703 [00:00<00:00, 4565.80it/s] word -> phonemes: 37%|███▋ | 1011/2703 [00:00<00:00, 5137.18it/s] word -> phonemes: 58%|█████▊ | 1573/2703 [00:00<00:00, 5353.70it/s] word -> phonemes: 78%|███████▊ | 2109/2703 [00:00<00:00, 5148.25it/s] word -> phonemes: 97%|█████████▋| 2625/2703 [00:00<00:00, 4826.29it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4922.30it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 7%|▋ | 241/3515 [00:00<00:01, 2406.53it/s] word -> phonemes: 14%|█▍ | 507/3515 [00:00<00:01, 2553.64it/s] word -> phonemes: 23%|██▎ | 802/3515 [00:00<00:00, 2733.34it/s] word -> phonemes: 31%|███ | 1076/3515 [00:00<00:00, 2461.25it/s] word -> phonemes: 40%|████ | 1419/3515 [00:00<00:00, 2781.41it/s] word -> phonemes: 48%|████▊ | 1702/3515 [00:00<00:00, 2685.66it/s] word -> phonemes: 56%|█████▌ | 1976/3515 [00:00<00:00, 2701.30it/s] word -> phonemes: 64%|██████▍ | 2249/3515 [00:00<00:00, 2694.66it/s] word -> phonemes: 72%|███████▏ | 2521/3515 [00:00<00:00, 2676.03it/s] word -> phonemes: 81%|████████ | 2834/3515 [00:01<00:00, 2811.35it/s] word -> phonemes: 89%|████████▉ | 3123/3515 [00:01<00:00, 2833.08it/s] word -> phonemes: 97%|█████████▋| 3408/3515 [00:01<00:00, 2778.91it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 2723.94it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 18%|█▊ | 495/2703 [00:00<00:00, 4945.71it/s] word -> phonemes: 37%|███▋ | 1007/2703 [00:00<00:00, 5043.27it/s] word -> phonemes: 57%|█████▋ | 1533/2703 [00:00<00:00, 5140.15it/s] word -> phonemes: 76%|███████▌ | 2048/2703 [00:00<00:00, 5024.18it/s] word -> phonemes: 94%|█████████▍| 2551/2703 [00:00<00:00, 4931.75it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4974.64it/s] dev: 0%| | 0/2703 [00:00