python/python-tiktoken
SHA256
14
0
Fork 0
forked from pool/python-tiktoken
Code Pull Requests Activity

- Update to version 0.8.0:

Browse Source 
* Alas, emulation
  * Attempt to fix emulated builds
  * Partial sync of codebase
  * Add possessive quantifiers to avoid catastrophic backtracking (#258)
  * update README to mention gpt-4o
  * Sync codebase
  * Simplify byte_pair_merge (#255)
  * Inline custom mapping function in _byte_pair_merge
  * Avoid calling byte_pair_encode for existing tokens
  * Performance improvements

OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-tiktoken?expand=0&rev=5
This commit is contained in:
Dirk Mueller
2024-11-21 09:21:27 +00:00
committed by Git OBS Bridge
parent 206a42ca14
commit d8c0e09456
7 changed files with 26 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
python-tiktoken.changes
View File

@@ -1,3 +1,17 @@
-------------------------------------------------------------------
Thu Nov 21 09:21:10 UTC 2024 - Dirk Müller <dmueller@suse.com>
- Update to version 0.8.0:
* Alas, emulation
* Attempt to fix emulated builds
* Partial sync of codebase
* Add possessive quantifiers to avoid catastrophic backtracking (#258)
* update README to mention gpt-4o
* Sync codebase
* Simplify byte_pair_merge (#255)
* Inline custom mapping function in _byte_pair_merge
* Avoid calling byte_pair_encode for existing tokens
-------------------------------------------------------------------
Fri Sep 20 06:53:00 UTC 2024 - Daniel Garcia <daniel.garcia@suse.com>
@@ -9,4 +23,4 @@ Thu Aug 22 17:25:09 UTC 2024 - Guang Yee <gyee@suse.com>
- Release v0.7.0
* Support for gpt-4o
* Performance improvements
* Performance improvements