/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 14%|█▎ | 477/3515 [00:00<00:00, 4767.07it/s] word -> phonemes: 28%|██▊ | 983/3515 [00:00<00:00, 4937.51it/s] word -> phonemes: 42%|████▏ | 1488/3515 [00:00<00:00, 4985.41it/s] word -> phonemes: 57%|█████▋ | 1987/3515 [00:00<00:00, 4882.92it/s] word -> phonemes: 70%|███████ | 2476/3515 [00:00<00:00, 4806.45it/s] word -> phonemes: 84%|████████▍ | 2959/3515 [00:00<00:00, 4813.37it/s] word -> phonemes: 98%|█████████▊| 3441/3515 [00:00<00:00, 4724.95it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4753.33it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 20%|█▉ | 531/2703 [00:00<00:00, 5301.50it/s] word -> phonemes: 40%|███▉ | 1075/2703 [00:00<00:00, 5379.36it/s] word -> phonemes: 60%|█████▉ | 1613/2703 [00:00<00:00, 5377.36it/s] word -> phonemes: 80%|███████▉ | 2151/2703 [00:00<00:00, 4851.23it/s] word -> phonemes: 98%|█████████▊| 2659/2703 [00:00<00:00, 4927.99it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5037.93it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 14%|█▍ | 389/2703 [00:00<00:00, 3882.92it/s] word -> phonemes: 30%|██▉ | 807/2703 [00:00<00:00, 4018.54it/s] word -> phonemes: 45%|████▍ | 1209/2703 [00:00<00:00, 3905.11it/s] word -> phonemes: 61%|██████ | 1654/2703 [00:00<00:00, 4114.73it/s] word -> phonemes: 80%|███████▉ | 2156/2703 [00:00<00:00, 4348.24it/s] word -> phonemes: 96%|█████████▌| 2591/2703 [00:00<00:00, 4317.65it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4192.14it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 18%|█▊ | 498/2703 [00:00<00:00, 4973.04it/s] word -> phonemes: 39%|███▉ | 1055/2703 [00:00<00:00, 5319.56it/s] word -> phonemes: 59%|█████▊ | 1587/2703 [00:00<00:00, 5039.41it/s] word -> phonemes: 77%|███████▋ | 2093/2703 [00:00<00:00, 4618.07it/s] word -> phonemes: 95%|█████████▍| 2560/2703 [00:00<00:00, 4292.04it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4478.97it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 457/3515 [00:00<00:00, 4563.28it/s] word -> phonemes: 27%|██▋ | 962/3515 [00:00<00:00, 4848.25it/s] word -> phonemes: 42%|████▏ | 1479/3515 [00:00<00:00, 4993.00it/s] word -> phonemes: 56%|█████▋ | 1984/3515 [00:00<00:00, 5014.21it/s] word -> phonemes: 71%|███████ | 2486/3515 [00:00<00:00, 4940.03it/s] word -> phonemes: 85%|████████▍ | 2981/3515 [00:00<00:00, 4933.12it/s] word -> phonemes: 99%|█████████▉| 3475/3515 [00:00<00:00, 4847.98it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4891.45it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 17%|█▋ | 471/2703 [00:00<00:00, 4703.48it/s] word -> phonemes: 35%|███▍ | 942/2703 [00:00<00:00, 4317.60it/s] word -> phonemes: 53%|█████▎ | 1438/2703 [00:00<00:00, 4594.64it/s] word -> phonemes: 70%|███████ | 1900/2703 [00:00<00:00, 4346.79it/s] word -> phonemes: 86%|████████▋ | 2338/2703 [00:00<00:00, 4131.25it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4197.00it/s] dev: 0%| | 0/2703 [00:00