stable-diffusion-webui-data.../scripts/tokenizer
toshiaki1729 43d8d8f65f
implement some features to manage token count (#52)
Add:
- Count and truncate by tokens amount (#40)
- Sort tags by token count

Change:
- Move "use raw clip token..." setting to "Settings" tab
- Show tag frequency, length or token count depending on the "Sort by"
2023-03-07 22:23:48 +09:00
..
__init__.py implement some features to manage token count (#52) 2023-03-07 22:23:48 +09:00
clip_tokenizer.py implement some features to manage token count (#52) 2023-03-07 22:23:48 +09:00