Index of /fairseq/examples/multilingual/data_scripts/
Name ↑
Size
Modified
⬆
..
📁
utils
-
2026-08-16 14:52
📜
binarize.py
6.8 KB
2026-08-16 14:52
📜
check_iswlt_test_data.py
2.7 KB
2026-08-16 14:52
📜
check_self_overlaps.py
3.6 KB
2026-08-16 14:52
📜
check_valid_test_overlaps.py
4.4 KB
2026-08-16 14:52
📜
dedup_all.py
1.8 KB
2026-08-16 14:52
⚡
download_af_xh.sh
4.3 KB
2026-08-16 14:52
⚡
download_flores_data.sh
9.5 KB
2026-08-16 14:52
⚡
download_iitb.sh
1.0 KB
2026-08-16 14:52
⚡
download_iwslt_and_extract.sh
6.1 KB
2026-08-16 14:52
⚡
download_lotus.sh
1.8 KB
2026-08-16 14:52
⚡
download_ML50_v1.sh
964 B
2026-08-16 14:52
📜
download_ted_and_extract.py
12.2 KB
2026-08-16 14:52
⚡
download_wat19_my.sh
1.2 KB
2026-08-16 14:52
📜
download_wmt19_and_before.py
36.8 KB
2026-08-16 14:52
⚡
download_wmt20.sh
23.3 KB
2026-08-16 14:52
⚡
preprocess_ML50_v1.sh
846 B
2026-08-16 14:52
📄
README.md
626 B
2026-08-16 14:52
📜
remove_valid_test_in_train.py
10.9 KB
2026-08-16 14:52
📄
requirement.txt
11 B
2026-08-16 14:52