/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") 2023-10-10 20:35:01 | WARNING | root | Pytorch pre-release version 2.1.0.dev20230831+cu118 - assuming intent to test it /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original0', 'encoder.pos_conv_embed.conv.parametrizations.weight.original1'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment mert_95M_4196_encode_norm2 {'model_config': None, 'refresh': False} using suno's k-means clusters: mert_95M_4196_encode_norm2 overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 4%|▎ | 126/3515 [00:00<00:02, 1250.55it/s] word -> phonemes: 8%|▊ | 283/3515 [00:00<00:02, 1437.16it/s] word -> phonemes: 13%|█▎ | 456/3515 [00:00<00:01, 1551.64it/s] word -> phonemes: 19%|█▉ | 660/3515 [00:00<00:01, 1742.34it/s] word -> phonemes: 24%|██▍ | 835/3515 [00:00<00:01, 1740.64it/s] word -> phonemes: 31%|███ | 1073/3515 [00:00<00:01, 1956.67it/s] word -> phonemes: 36%|███▌ | 1269/3515 [00:00<00:01, 1928.64it/s] word -> phonemes: 42%|████▏ | 1463/3515 [00:00<00:01, 1747.28it/s] word -> phonemes: 47%|████▋ | 1641/3515 [00:00<00:01, 1746.31it/s] word -> phonemes: 52%|█████▏ | 1827/3515 [00:01<00:00, 1762.74it/s] word -> phonemes: 57%|█████▋ | 2005/3515 [00:01<00:00, 1694.39it/s] word -> phonemes: 62%|██████▏ | 2178/3515 [00:01<00:00, 1700.23it/s] word -> phonemes: 67%|██████▋ | 2350/3515 [00:01<00:00, 1572.95it/s] word -> phonemes: 73%|███████▎ | 2557/3515 [00:01<00:00, 1708.10it/s] word -> phonemes: 79%|███████▉ | 2777/3515 [00:01<00:00, 1826.76it/s] word -> phonemes: 84%|████████▍ | 2963/3515 [00:01<00:00, 1786.27it/s] word -> phonemes: 89%|████████▉ | 3144/3515 [00:01<00:00, 1644.96it/s] word -> phonemes: 95%|█████████▍| 3334/3515 [00:01<00:00, 1713.00it/s] word -> phonemes: 100%|█████████▉| 3509/3515 [00:02<00:00, 1710.42it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:02<00:00, 1719.43it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 13%|█▎ | 360/2703 [00:00<00:00, 3597.69it/s] word -> phonemes: 27%|██▋ | 720/2703 [00:00<00:00, 3494.03it/s] word -> phonemes: 40%|████ | 1094/2703 [00:00<00:00, 3600.00it/s] word -> phonemes: 54%|█████▍ | 1455/2703 [00:00<00:00, 3446.57it/s] word -> phonemes: 67%|██████▋ | 1817/2703 [00:00<00:00, 3502.66it/s] word -> phonemes: 80%|████████ | 2170/2703 [00:00<00:00, 3507.28it/s] word -> phonemes: 93%|█████████▎| 2522/2703 [00:00<00:00, 3211.48it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3317.10it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 12%|█▏ | 333/2703 [00:00<00:00, 3329.78it/s] word -> phonemes: 25%|██▌ | 677/2703 [00:00<00:00, 3390.68it/s] word -> phonemes: 38%|███▊ | 1018/2703 [00:00<00:00, 3398.12it/s] word -> phonemes: 51%|█████ | 1370/2703 [00:00<00:00, 3443.88it/s] word -> phonemes: 63%|██████▎ | 1715/2703 [00:00<00:00, 3423.13it/s] word -> phonemes: 77%|███████▋ | 2078/2703 [00:00<00:00, 3489.87it/s] word -> phonemes: 90%|████████▉ | 2428/2703 [00:00<00:00, 3480.45it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 3432.24it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 10%|█ | 276/2703 [00:00<00:00, 2754.14it/s] word -> phonemes: 20%|██ | 552/2703 [00:00<00:00, 2724.01it/s] word -> phonemes: 31%|███ | 837/2703 [00:00<00:00, 2779.16it/s] word -> phonemes: 41%|████▏ | 1119/2703 [00:00<00:00, 2794.50it/s] word -> phonemes: 52%|█████▏ | 1405/2703 [00:00<00:00, 2817.75it/s] word -> phonemes: 63%|██████▎ | 1710/2703 [00:00<00:00, 2895.59it/s] word -> phonemes: 74%|███████▍ | 2001/2703 [00:00<00:00, 2898.49it/s] word -> phonemes: 85%|████████▌ | 2298/2703 [00:00<00:00, 2913.61it/s] word -> phonemes: 96%|█████████▌| 2590/2703 [00:00<00:00, 2855.02it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 2836.32it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 7%|▋ | 263/3515 [00:00<00:01, 2617.37it/s] word -> phonemes: 15%|█▍ | 526/3515 [00:00<00:01, 2622.23it/s] word -> phonemes: 23%|██▎ | 795/3515 [00:00<00:01, 2649.36it/s] word -> phonemes: 30%|███ | 1060/3515 [00:00<00:00, 2627.59it/s] word -> phonemes: 38%|███▊ | 1329/3515 [00:00<00:00, 2649.09it/s] word -> phonemes: 45%|████▌ | 1596/3515 [00:00<00:00, 2655.93it/s] word -> phonemes: 53%|█████▎ | 1862/3515 [00:00<00:00, 2604.04it/s] word -> phonemes: 61%|██████ | 2137/3515 [00:00<00:00, 2646.95it/s] word -> phonemes: 68%|██████▊ | 2402/3515 [00:00<00:00, 2595.75it/s] word -> phonemes: 76%|███████▌ | 2662/3515 [00:01<00:00, 2587.86it/s] word -> phonemes: 83%|████████▎ | 2924/3515 [00:01<00:00, 2597.40it/s] word -> phonemes: 91%|█████████ | 3184/3515 [00:01<00:00, 2587.19it/s] word -> phonemes: 98%|█████████▊| 3443/3515 [00:01<00:00, 2570.59it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 2609.24it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 10%|█ | 283/2703 [00:00<00:00, 2825.60it/s] word -> phonemes: 21%|██ | 566/2703 [00:00<00:00, 2740.21it/s] word -> phonemes: 31%|███▏ | 851/2703 [00:00<00:00, 2785.22it/s] word -> phonemes: 42%|████▏ | 1130/2703 [00:00<00:00, 2735.45it/s] word -> phonemes: 52%|█████▏ | 1407/2703 [00:00<00:00, 2746.30it/s] word -> phonemes: 63%|██████▎ | 1694/2703 [00:00<00:00, 2786.53it/s] word -> phonemes: 74%|███████▎ | 1987/2703 [00:00<00:00, 2832.95it/s] word -> phonemes: 85%|████████▍ | 2289/2703 [00:00<00:00, 2890.66it/s] word -> phonemes: 95%|█████████▌| 2579/2703 [00:00<00:00, 2851.84it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:00<00:00, 2811.81it/s] dev: 0%| | 0/2703 [00:00