Calculate the number of language model tokens for a string

17 pointsby waldekm3 months ago

1 comment

sva_3 months ago

<p><pre><code> import tiktoken enc = tiktoken.encoding_for_model('o1-mini') len(enc.encode('some string'))</code></pre>

评论 #42948671 未加载