/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment m-a-p/MERT-v1-330M {'model_config': None, 'refresh': False} overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 10%|█ | 352/3515 [00:00<00:00, 3512.71it/s] word -> phonemes: 20%|██ | 704/3515 [00:00<00:00, 3330.11it/s] word -> phonemes: 30%|██▉ | 1038/3515 [00:00<00:00, 3233.22it/s] word -> phonemes: 40%|████ | 1407/3515 [00:00<00:00, 3406.68it/s] word -> phonemes: 50%|████▉ | 1749/3515 [00:00<00:00, 3375.27it/s] word -> phonemes: 59%|█████▉ | 2088/3515 [00:00<00:00, 3235.63it/s] word -> phonemes: 71%|███████ | 2483/3515 [00:00<00:00, 3456.66it/s] word -> phonemes: 81%|████████ | 2831/3515 [00:00<00:00, 3386.21it/s] word -> phonemes: 90%|█████████ | 3176/3515 [00:00<00:00, 3368.78it/s] word -> phonemes: 100%|█████████▉| 3514/3515 [00:01<00:00, 3161.31it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 3293.28it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 569/2703 [00:00<00:00, 5688.03it/s] word -> phonemes: 43%|████▎ | 1170/2703 [00:00<00:00, 5872.05it/s] word -> phonemes: 65%|██████▌ | 1758/2703 [00:00<00:00, 5745.48it/s] word -> phonemes: 88%|████████▊ | 2367/2703 [00:00<00:00, 5878.51it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5848.63it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██▏ | 578/2703 [00:00<00:00, 5770.06it/s] word -> phonemes: 43%|████▎ | 1156/2703 [00:00<00:00, 5587.34it/s] word -> phonemes: 64%|██████▍ | 1743/2703 [00:00<00:00, 5710.37it/s] word -> phonemes: 86%|████████▌ | 2322/2703 [00:00<00:00, 5737.79it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5661.86it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 19%|█▉ | 524/2703 [00:00<00:00, 5233.28it/s] word -> phonemes: 39%|███▉ | 1055/2703 [00:00<00:00, 5272.03it/s] word -> phonemes: 60%|██████ | 1626/2703 [00:00<00:00, 5468.54it/s] word -> phonemes: 82%|████████▏ | 2215/2703 [00:00<00:00, 5631.29it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5527.64it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 11%|█ | 381/3515 [00:00<00:00, 3804.83it/s] word -> phonemes: 22%|██▏ | 762/3515 [00:00<00:00, 3672.68it/s] word -> phonemes: 32%|███▏ | 1130/3515 [00:00<00:00, 3268.52it/s] word -> phonemes: 45%|████▌ | 1588/3515 [00:00<00:00, 3690.57it/s] word -> phonemes: 56%|█████▌ | 1963/3515 [00:00<00:00, 3633.37it/s] word -> phonemes: 66%|██████▋ | 2330/3515 [00:00<00:00, 3112.16it/s] word -> phonemes: 76%|███████▌ | 2654/3515 [00:00<00:00, 3068.76it/s] word -> phonemes: 85%|████████▌ | 3004/3515 [00:00<00:00, 3189.61it/s] word -> phonemes: 96%|█████████▌| 3357/3515 [00:01<00:00, 3257.78it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 3324.50it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 21%|██ | 564/2703 [00:00<00:00, 5636.90it/s] word -> phonemes: 42%|████▏ | 1128/2703 [00:00<00:00, 5329.49it/s] word -> phonemes: 64%|██████▍ | 1739/2703 [00:00<00:00, 5673.92it/s] word -> phonemes: 86%|████████▋ | 2336/2703 [00:00<00:00, 5788.08it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5546.18it/s] dev: 0%| | 0/2703 [00:00