EleutherAI
/

polyglot-ko-1.3b

Text Generation

text-generation-inference

Model card Files Files and versions

hyunwoongko commited on Sep 15, 2022

Commit

e33a677

·

1 Parent(s): 7860e50

Update special_tokens_map.json

Files changed (1) hide show

special_tokens_map.json +2 -2

special_tokens_map.json CHANGED Viewed

@@ -6,6 +6,6 @@
     "<|tel|>",
     "<|rrn|>"
   ],
-  "eos_token": "<eos>",
-  "pad_token": "<pad>"
 }

     "<|tel|>",
     "<|rrn|>"
   ],
+  "eos_token": "<|endoftext|>>",
+  "pad_token": "<|endoftext|>>"
 }