/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-95M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 12%|█▏ | 415/3515 [00:00<00:00, 4140.18it/s] word -> phonemes: 24%|██▎ | 830/3515 [00:00<00:00, 3509.94it/s] word -> phonemes: 34%|███▍ | 1188/3515 [00:00<00:00, 3281.76it/s] word -> phonemes: 45%|████▍ | 1566/3515 [00:00<00:00, 3458.44it/s] word -> phonemes: 55%|█████▍ | 1916/3515 [00:00<00:00, 3278.76it/s] word -> phonemes: 64%|██████▍ | 2248/3515 [00:00<00:00, 3175.27it/s] word -> phonemes: 75%|███████▌ | 2641/3515 [00:00<00:00, 3400.35it/s] word -> phonemes: 85%|████████▍ | 2985/3515 [00:00<00:00, 3099.91it/s] word -> phonemes: 94%|█████████▍| 3302/3515 [00:01<00:00, 3022.70it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 3155.65it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 17%|█▋ | 460/2703 [00:00<00:00, 4597.15it/s] word -> phonemes: 36%|███▌ | 960/2703 [00:00<00:00, 4833.63it/s] word -> phonemes: 53%|█████▎ | 1444/2703 [00:00<00:00, 4816.85it/s] word -> phonemes: 75%|███████▌ | 2033/2703 [00:00<00:00, 5238.44it/s] word -> phonemes: 96%|█████████▋| 2603/2703 [00:00<00:00, 5402.65it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5197.73it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 19%|█▉ | 507/2703 [00:00<00:00, 5064.14it/s] word -> phonemes: 38%|███▊ | 1036/2703 [00:00<00:00, 5192.31it/s] word -> phonemes: 61%|██████ | 1636/2703 [00:00<00:00, 5559.88it/s] word -> phonemes: 81%|████████ | 2193/2703 [00:00<00:00, 5502.99it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5421.51it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 557/2703 [00:00<00:00, 5566.13it/s] word -> phonemes: 41%|████▏ | 1118/2703 [00:00<00:00, 5591.48it/s] word -> phonemes: 64%|██████▎ | 1717/2703 [00:00<00:00, 5771.96it/s] word -> phonemes: 85%|████████▌ | 2301/2703 [00:00<00:00, 5795.09it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5527.28it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 10%|▉ | 336/3515 [00:00<00:00, 3356.70it/s] word -> phonemes: 22%|██▏ | 776/3515 [00:00<00:00, 3962.41it/s] word -> phonemes: 34%|███▍ | 1194/3515 [00:00<00:00, 4058.20it/s] word -> phonemes: 46%|████▌ | 1610/3515 [00:00<00:00, 4096.16it/s] word -> phonemes: 58%|█████▊ | 2042/3515 [00:00<00:00, 4175.84it/s] word -> phonemes: 70%|██████▉ | 2460/3515 [00:00<00:00, 3891.20it/s] word -> phonemes: 83%|████████▎ | 2902/3515 [00:00<00:00, 4054.01it/s] word -> phonemes: 95%|█████████▍| 3330/3515 [00:00<00:00, 4122.89it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4071.73it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 571/2703 [00:00<00:00, 5700.65it/s] word -> phonemes: 42%|████▏ | 1142/2703 [00:00<00:00, 5532.87it/s] word -> phonemes: 63%|██████▎ | 1696/2703 [00:00<00:00, 4979.53it/s] word -> phonemes: 82%|████████▏ | 2219/2703 [00:00<00:00, 5070.74it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5209.62it/s] dev: 0%| | 0/2703 [00:00