/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-95M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 5%|▍ | 168/3515 [00:00<00:01, 1676.62it/s] word -> phonemes: 10%|▉ | 336/3515 [00:00<00:02, 1544.43it/s] word -> phonemes: 18%|█▊ | 629/3515 [00:00<00:01, 2144.67it/s] word -> phonemes: 24%|██▍ | 847/3515 [00:00<00:01, 2088.45it/s] word -> phonemes: 30%|███ | 1058/3515 [00:00<00:01, 2046.69it/s] word -> phonemes: 36%|███▌ | 1264/3515 [00:00<00:01, 2015.21it/s] word -> phonemes: 43%|████▎ | 1511/3515 [00:00<00:00, 2156.74it/s] word -> phonemes: 51%|█████ | 1777/3515 [00:00<00:00, 2302.67it/s] word -> phonemes: 57%|█████▋ | 2009/3515 [00:00<00:00, 2178.56it/s] word -> phonemes: 64%|██████▍ | 2246/3515 [00:01<00:00, 2213.85it/s] word -> phonemes: 70%|███████ | 2469/3515 [00:01<00:00, 2171.19it/s] word -> phonemes: 77%|███████▋ | 2689/3515 [00:01<00:00, 2174.22it/s] word -> phonemes: 83%|████████▎ | 2908/3515 [00:01<00:00, 2084.54it/s] word -> phonemes: 92%|█████████▏| 3229/3515 [00:01<00:00, 2405.67it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 2224.07it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 561/2703 [00:00<00:00, 5608.59it/s] word -> phonemes: 44%|████▎ | 1177/2703 [00:00<00:00, 5931.67it/s] word -> phonemes: 66%|██████▌ | 1771/2703 [00:00<00:00, 5263.03it/s] word -> phonemes: 85%|████████▌ | 2306/2703 [00:00<00:00, 5164.65it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5272.98it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 16%|█▌ | 425/2703 [00:00<00:00, 4242.36it/s] word -> phonemes: 37%|███▋ | 991/2703 [00:00<00:00, 5074.09it/s] word -> phonemes: 58%|█████▊ | 1565/2703 [00:00<00:00, 5377.31it/s] word -> phonemes: 79%|███████▉ | 2142/2703 [00:00<00:00, 5530.62it/s] word -> phonemes: 100%|█████████▉| 2696/2703 [00:00<00:00, 5320.74it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5269.21it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 19%|█▉ | 515/2703 [00:00<00:00, 5147.27it/s] word -> phonemes: 40%|████ | 1089/2703 [00:00<00:00, 5491.93it/s] word -> phonemes: 61%|██████ | 1639/2703 [00:00<00:00, 5386.73it/s] word -> phonemes: 82%|████████▏ | 2211/2703 [00:00<00:00, 5513.21it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5428.04it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 454/3515 [00:00<00:00, 4530.89it/s] word -> phonemes: 26%|██▋ | 925/3515 [00:00<00:00, 4631.85it/s] word -> phonemes: 40%|███▉ | 1389/3515 [00:00<00:00, 4464.49it/s] word -> phonemes: 53%|█████▎ | 1862/3515 [00:00<00:00, 4565.08it/s] word -> phonemes: 66%|██████▌ | 2320/3515 [00:00<00:00, 4536.83it/s] word -> phonemes: 79%|███████▉ | 2793/3515 [00:00<00:00, 4600.26it/s] word -> phonemes: 93%|█████████▎| 3254/3515 [00:00<00:00, 4507.51it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4515.98it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 18%|█▊ | 492/2703 [00:00<00:00, 4917.24it/s] word -> phonemes: 38%|███▊ | 1036/2703 [00:00<00:00, 5222.07it/s] word -> phonemes: 58%|█████▊ | 1559/2703 [00:00<00:00, 4888.73it/s] word -> phonemes: 80%|███████▉ | 2149/2703 [00:00<00:00, 5270.59it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5256.25it/s] dev: 0%| | 0/2703 [00:00