/home/tony/Work/glockenspiel/s3prl/s3prl/upstream/byol_s/byol_a/common.py:20: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend("sox_io") 2023-09-23 00:55:29 | WARNING | root | Pytorch pre-release version 2.1.0.dev20230831+cu118 - assuming intent to test it /home/tony/Work/glockenspiel/s3prl/s3prl/run_downstream.py:157: UserWarning: torchaudio._backend.set_audio_backend has been deprecated. With dispatcher enabled, this function is no-op. You can remove the function call. torchaudio.set_audio_backend('sox_io') Some weights of the model checkpoint at m-a-p/MERT-v1-95M were not used when initializing MERTModel: ['encoder.pos_conv_embed.conv.weight_v', 'encoder.pos_conv_embed.conv.weight_g'] - This IS expected if you are initializing MERTModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing MERTModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). Some weights of MERTModel were not initialized from the model checkpoint at m-a-p/MERT-v1-95M and are newly initialized: ['encoder.pos_conv_embed.conv.parametrizations.weight.original1', 'encoder.pos_conv_embed.conv.parametrizations.weight.original0'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. [Featurizer] - The selected feature hidden_states's downsample rate is 320 [Runner] - Start a new experiment mert_95M_encode {'model_config': None, 'refresh': False} using suno's k-means clusters: mert_95M_encode overall: 0%| | 0/4000 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 7%|▋ | 243/3515 [00:00<00:01, 2425.43it/s] word -> phonemes: 14%|█▍ | 486/3515 [00:00<00:01, 2322.55it/s] word -> phonemes: 21%|██▏ | 755/3515 [00:00<00:01, 2485.61it/s] word -> phonemes: 29%|██▊ | 1005/3515 [00:00<00:01, 2411.59it/s] word -> phonemes: 37%|███▋ | 1290/3515 [00:00<00:00, 2562.24it/s] word -> phonemes: 45%|████▌ | 1583/3515 [00:00<00:00, 2681.96it/s] word -> phonemes: 53%|█████▎ | 1852/3515 [00:00<00:00, 2585.34it/s] word -> phonemes: 60%|██████ | 2125/3515 [00:00<00:00, 2627.76it/s] word -> phonemes: 68%|██████▊ | 2389/3515 [00:00<00:00, 2536.18it/s] word -> phonemes: 75%|███████▌ | 2644/3515 [00:01<00:00, 2539.73it/s] word -> phonemes: 83%|████████▎ | 2902/3515 [00:01<00:00, 2549.38it/s] word -> phonemes: 91%|█████████ | 3184/3515 [00:01<00:00, 2629.75it/s] word -> phonemes: 98%|█████████▊| 3448/3515 [00:01<00:00, 2570.97it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 2556.24it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 6%|▌ | 162/2703 [00:00<00:01, 1571.78it/s] word -> phonemes: 15%|█▌ | 408/2703 [00:00<00:01, 2083.74it/s] word -> phonemes: 26%|██▌ | 692/2703 [00:00<00:00, 2424.15it/s] word -> phonemes: 35%|███▍ | 935/2703 [00:00<00:00, 2379.60it/s] word -> phonemes: 44%|████▎ | 1176/2703 [00:00<00:00, 2387.99it/s] word -> phonemes: 56%|█████▌ | 1508/2703 [00:00<00:00, 2699.19it/s] word -> phonemes: 67%|██████▋ | 1816/2703 [00:00<00:00, 2820.49it/s] word -> phonemes: 79%|███████▉ | 2144/2703 [00:00<00:00, 2964.21it/s] word -> phonemes: 90%|█████████ | 2441/2703 [00:00<00:00, 2960.24it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:01<00:00, 2631.05it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 11%|█ | 291/2703 [00:00<00:00, 2900.44it/s] word -> phonemes: 22%|██▏ | 582/2703 [00:00<00:00, 2905.96it/s] word -> phonemes: 32%|███▏ | 873/2703 [00:00<00:00, 2899.78it/s] word -> phonemes: 43%|████▎ | 1163/2703 [00:00<00:00, 2660.07it/s] word -> phonemes: 54%|█████▍ | 1457/2703 [00:00<00:00, 2718.03it/s] word -> phonemes: 64%|██████▍ | 1731/2703 [00:00<00:00, 2336.29it/s] word -> phonemes: 74%|███████▍ | 2009/2703 [00:00<00:00, 2461.85it/s] word -> phonemes: 84%|████████▎ | 2263/2703 [00:00<00:00, 2482.80it/s] word -> phonemes: 95%|█████████▍| 2563/2703 [00:00<00:00, 2631.79it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:01<00:00, 2634.73it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 8%|▊ | 219/2703 [00:00<00:01, 2183.63it/s] word -> phonemes: 16%|█▌ | 438/2703 [00:00<00:01, 2163.20it/s] word -> phonemes: 24%|██▍ | 655/2703 [00:00<00:00, 2151.35it/s] word -> phonemes: 33%|███▎ | 885/2703 [00:00<00:00, 2207.61it/s] word -> phonemes: 41%|████ | 1106/2703 [00:00<00:00, 2193.44it/s] word -> phonemes: 49%|████▉ | 1326/2703 [00:00<00:00, 2191.12it/s] word -> phonemes: 58%|█████▊ | 1555/2703 [00:00<00:00, 2222.90it/s] word -> phonemes: 66%|██████▌ | 1790/2703 [00:00<00:00, 2262.49it/s] word -> phonemes: 75%|███████▌ | 2036/2703 [00:00<00:00, 2323.48it/s] word -> phonemes: 87%|████████▋ | 2361/2703 [00:01<00:00, 2606.87it/s] word -> phonemes: 99%|█████████▉| 2678/2703 [00:01<00:00, 2777.75it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:01<00:00, 2423.10it/s] dev: 0%| | 0/2703 [00:00 phonemes: 0%| | 0/3515 [00:00 phonemes: 5%|▍ | 175/3515 [00:00<00:01, 1744.98it/s] word -> phonemes: 10%|▉ | 350/3515 [00:00<00:01, 1594.86it/s] word -> phonemes: 15%|█▌ | 531/3515 [00:00<00:01, 1683.56it/s] word -> phonemes: 20%|██ | 720/3515 [00:00<00:01, 1760.38it/s] word -> phonemes: 26%|██▌ | 897/3515 [00:00<00:01, 1753.86it/s] word -> phonemes: 31%|███ | 1084/3515 [00:00<00:01, 1790.30it/s] word -> phonemes: 36%|███▋ | 1278/3515 [00:00<00:01, 1838.11it/s] word -> phonemes: 42%|████▏ | 1463/3515 [00:00<00:01, 1840.43it/s] word -> phonemes: 47%|████▋ | 1648/3515 [00:00<00:01, 1838.99it/s] word -> phonemes: 52%|█████▏ | 1840/3515 [00:01<00:00, 1859.47it/s] word -> phonemes: 58%|█████▊ | 2027/3515 [00:01<00:00, 1843.85it/s] word -> phonemes: 63%|██████▎ | 2224/3515 [00:01<00:00, 1880.74it/s] word -> phonemes: 69%|██████▊ | 2413/3515 [00:01<00:00, 1782.22it/s] word -> phonemes: 74%|███████▍ | 2597/3515 [00:01<00:00, 1797.93it/s] word -> phonemes: 79%|███████▉ | 2782/3515 [00:01<00:00, 1812.90it/s] word -> phonemes: 84%|████████▍ | 2964/3515 [00:01<00:00, 1783.84it/s] word -> phonemes: 89%|████████▉ | 3143/3515 [00:01<00:00, 1757.88it/s] word -> phonemes: 94%|█████████▍| 3320/3515 [00:01<00:00, 1743.23it/s] word -> phonemes: 99%|█████████▉| 3495/3515 [00:01<00:00, 1724.34it/s] word -> phonemes: 100%|██████████| 3515/3515 [00:01<00:00, 1779.60it/s] train: 0%| | 0/3515 [00:00 phonemes: 0%| | 0/2703 [00:00 phonemes: 8%|▊ | 213/2703 [00:00<00:01, 2125.83it/s] word -> phonemes: 16%|█▌ | 430/2703 [00:00<00:01, 2149.26it/s] word -> phonemes: 24%|██▍ | 645/2703 [00:00<00:00, 2130.96it/s] word -> phonemes: 32%|███▏ | 861/2703 [00:00<00:00, 2139.64it/s] word -> phonemes: 40%|███▉ | 1079/2703 [00:00<00:00, 2150.55it/s] word -> phonemes: 48%|████▊ | 1296/2703 [00:00<00:00, 2155.30it/s] word -> phonemes: 56%|█████▌ | 1513/2703 [00:00<00:00, 2159.08it/s] word -> phonemes: 64%|██████▍ | 1734/2703 [00:00<00:00, 2171.99it/s] word -> phonemes: 72%|███████▏ | 1952/2703 [00:00<00:00, 2173.81it/s] word -> phonemes: 80%|████████ | 2173/2703 [00:01<00:00, 2183.85it/s] word -> phonemes: 88%|████████▊ | 2392/2703 [00:01<00:00, 2163.23it/s] word -> phonemes: 97%|█████████▋| 2609/2703 [00:01<00:00, 2155.11it/s] word -> phonemes: 100%|██████████| 2703/2703 [00:01<00:00, 2149.76it/s] dev: 0%| | 0/2703 [00:00