/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") 2023-10-11 21:13:49 | WARNING | root | Pytorch pre-release version 2.1.0.dev20230831+cu118 - assuming intent to test it /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-330M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-330M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original0', 'encoder.pos_conv_embed.conv.parametrizations.weight.original1'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment mert_330M_encode {'model_config': None, 'refresh': False} using suno's k-means clusters: mert_330M_encode overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 13%|█▎ | 464/3515 [00:00<00:00, 4638.43it/s] word -> phonemes: 26%|██▋ | 928/3515 [00:00<00:00, 4435.83it/s] word -> phonemes: 40%|███▉ | 1391/3515 [00:00<00:00, 4520.75it/s] word -> phonemes: 52%|█████▏ | 1844/3515 [00:00<00:00, 4500.98it/s] word -> phonemes: 66%|██████▌ | 2316/3515 [00:00<00:00, 4578.43it/s] word -> phonemes: 79%|███████▉ | 2775/3515 [00:00<00:00, 4440.00it/s] word -> phonemes: 92%|█████████▏| 3238/3515 [00:00<00:00, 4499.91it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4492.12it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 601/2703 [00:00<00:00, 6000.99it/s] word -> phonemes: 45%|████▌ | 1218/2703 [00:00<00:00, 6096.77it/s] word -> phonemes: 69%|██████▊ | 1857/2703 [00:00<00:00, 6229.28it/s] word -> phonemes: 92%|█████████▏| 2480/2703 [00:00<00:00, 5984.27it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5977.67it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 601/2703 [00:00<00:00, 6004.17it/s] word -> phonemes: 45%|████▌ | 1222/2703 [00:00<00:00, 6119.95it/s] word -> phonemes: 68%|██████▊ | 1834/2703 [00:00<00:00, 5882.26it/s] word -> phonemes: 90%|█████████ | 2442/2703 [00:00<00:00, 5958.09it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5930.21it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 6%|▌ | 163/2703 [00:00<00:03, 702.49it/s] word -> phonemes: 27%|██▋ | 743/2703 [00:00<00:00, 2644.77it/s] word -> phonemes: 50%|████▉ | 1346/2703 [00:00<00:00, 3836.55it/s] word -> phonemes: 72%|███████▏ | 1952/2703 [00:00<00:00, 4579.04it/s] word -> phonemes: 94%|█████████▎| 2530/2703 [00:00<00:00, 4966.72it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 4071.35it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 12%|█▏ | 417/3515 [00:00<00:00, 4165.02it/s] word -> phonemes: 24%|██▍ | 843/3515 [00:00<00:00, 4216.13it/s] word -> phonemes: 37%|███▋ | 1289/3515 [00:00<00:00, 4327.22it/s] word -> phonemes: 49%|████▉ | 1722/3515 [00:00<00:00, 4322.86it/s] word -> phonemes: 62%|██████▏ | 2179/3515 [00:00<00:00, 4408.64it/s] word -> phonemes: 75%|███████▍ | 2620/3515 [00:00<00:00, 4166.25it/s] word -> phonemes: 87%|████████▋ | 3068/3515 [00:00<00:00, 4263.88it/s] word -> phonemes: 100%|█████████▉| 3503/3515 [00:00<00:00, 4290.14it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:00<00:00, 4282.15it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 22%|██▏ | 583/2703 [00:00<00:00, 5828.49it/s] word -> phonemes: 44%|████▎ | 1181/2703 [00:00<00:00, 5914.68it/s] word -> phonemes: 66%|██████▌ | 1773/2703 [00:00<00:00, 5843.69it/s] word -> phonemes: 88%|████████▊ | 2368/2703 [00:00<00:00, 5882.24it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 5834.90it/s] dev: 0%| | 0/2703 [00:00