tanxing
/
MyArena
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
4 Commits
1 Branch
0 Tags
8.9 GiB
 
Tree: 3ee8d630b7
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '3ee8d630b7'
${ noResults }
MyArena/model/tokenizers/zh/special_tokens_map.json

6 lines
99 B
Raw Blame History

{
"bos_token": "[BOS]",
"eos_token": "[EOS]",
"pad_token": "[PAD]",
"unk_token": "[UNK]"
}