Megatron-LM adjusted to Polish texts

925a6c9f · Jan Kocoń · 78e7e33c · 925a6c9f · 925a6c9f · 925a6c9f
Commit 925a6c9f authored Mar 1, 2021 by Jan Kocoń
--- a/mpu/layers.py
+++ b/mpu/layers.py
--- a/mpu/mappings.py
+++ b/mpu/mappings.py
--- a/mpu/random.py
+++ b/mpu/random.py
--- a/mpu/tests/__init__.py
+++ b/mpu/tests/__init__.py
--- a/mpu/tests/commons.py
+++ b/mpu/tests/commons.py
--- a/mpu/tests/test_cross_entropy.py
+++ b/mpu/tests/test_cross_entropy.py
--- a/mpu/tests/test_data.py
+++ b/mpu/tests/test_data.py
--- a/mpu/tests/test_initialize.py
+++ b/mpu/tests/test_initialize.py
--- a/mpu/tests/test_layers.py
+++ b/mpu/tests/test_layers.py
--- a/mpu/tests/test_random.py
+++ b/mpu/tests/test_random.py
--- a/mpu/transformer.py
+++ b/mpu/transformer.py
--- a/mpu/utils.py
+++ b/mpu/utils.py
--- a/new_learning_log.txt
+++ b/new_learning_log.txt
--- a/new_learning_log2.txt
+++ b/new_learning_log2.txt
--- a/new_learning_log3.txt
+++ b/new_learning_log3.txt
--- a/openwebtext/README.md
+++ b/openwebtext/README.md
--- a/openwebtext/blacklist_urls.py
+++ b/openwebtext/blacklist_urls.py
--- a/openwebtext/cleanup_dataset.py
+++ b/openwebtext/cleanup_dataset.py
--- a/openwebtext/find_duplicates.py
+++ b/openwebtext/find_duplicates.py
--- a/openwebtext/group_duplicates_url.py
+++ b/openwebtext/group_duplicates_url.py