top | item 46907876 (no title) siwatanejo | 24 days ago > All 7 books come to ~1.75M tokensHow do you know? Each word is one token? discuss order hn newest koakuma-chan|24 days ago You can download the books and run them through a tokenizer. I did that half a year ago and got ~2M.
koakuma-chan|24 days ago You can download the books and run them through a tokenizer. I did that half a year ago and got ~2M.
koakuma-chan|24 days ago