forked from pool/python-tiktoken
* Alas, emulation * Attempt to fix emulated builds * Partial sync of codebase * Add possessive quantifiers to avoid catastrophic backtracking (#258) * update README to mention gpt-4o * Sync codebase * Simplify byte_pair_merge (#255) * Inline custom mapping function in _byte_pair_merge * Avoid calling byte_pair_encode for existing tokens * Performance improvements OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-tiktoken?expand=0&rev=5
4 lines
236 B
Plaintext
4 lines
236 B
Plaintext
<servicedata>
|
|
<service name="tar_scm">
|
|
<param name="url">https://github.com/openai/tiktoken.git</param>
|
|
<param name="changesrevision">63527649963def8c759b0f91f2eb69a40934e468</param></service></servicedata> |