pool/python-tokenizers
SHA256
17
0
Fork 0
Code Issues Pull Requests Activity

Accepting request 1231910 from home:uncomfyhalomacro:branches:science:machinelearning

Browse Source 
- Update to version 0.21.0:
  * More cache options.
  * Disable caching for long strings.
  * Testing ABI3 wheels to reduce number of wheels
  * Adding an API for decode streaming.
  * Decode stream python
  * Fix encode_batch and encode_batch_fast to accept ndarrays again

OBS-URL: https://build.opensuse.org/request/show/1231910
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8
This commit is contained in:
Guang Yee
2024-12-18 17:58:42 +00:00
committed by Git OBS Bridge
parent 5e74175ce9
commit 82d122dfa5
6 changed files with 18 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python-tokenizers.spec
View File

@@ -22,7 +22,7 @@
%{?sle15_python_module_pythons}
Name: python-tokenizers
Version: 0.20.3
Version: 0.21.0
Release: 0
Summary: Provides an implementation of today's most used tokenizers
License: Apache-2.0