pool/python-tokenizers
SHA256
17
0
Fork 0
Code Issues Pull Requests Activity
18 Commits 3 Branches 0 Tags
factory
Commit Graph

3 Commits

Author SHA256 Message Date
Guang Yee
82d122dfa5 Accepting request 1231910 from home:uncomfyhalomacro:branches:science:machinelearning 
- Update to version 0.21.0:
  * More cache options.
  * Disable caching for long strings.
  * Testing ABI3 wheels to reduce number of wheels
  * Adding an API for decode streaming.
  * Decode stream python
  * Fix encode_batch and encode_batch_fast to accept ndarrays again

OBS-URL: https://build.opensuse.org/request/show/1231910
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8
 2024-12-18 17:58:42 +00:00
Guang Yee
5e74175ce9 Accepting request 1222140 from home:uncomfyhalomacro:branches:science:machinelearning 
- Select only rust tier 1 arches. 
- Update registry.tar.zst dependencies
- Update version to 0.20.3:
  * fix pylist
  * [MINOR:TYP] Fix docstrings
- Updates from 0.20.2:
  * Bump cookie and express in /tokenizers/examples/unstable_wasm/www
  * Fix off-by-one error in tokenizer::normalizer::Range::len
  * Arg name correction: auth_token -> token
  * Unsound call of set_var
  * Add safety comments
  * PyO3 0.22
- Updates from 0.20.1:
  * Update README.md
  * fix benchmark file link
  * [ignore_merges] Fix offsets
  * Bump body-parser and express in /tokenizers/examples/unstable_wasm/www
  * Bump serve-static and express in /tokenizers/examples/unstable_wasm/www
  * Bump send and express in /tokenizers/examples/unstable_wasm/www
  * Bump webpack from 5.76.0 to 5.95.0 in /tokenizers/examples/unstable_wasm/www
  * Fix documentation build
  * style: simplify string formatting for readability
- Experiment with cargo vendor home registry. See documentation:
  https://github.com/openSUSE-Rust/obs-service-cargo/blob/master/README.md#cargo-vendor-home-registry

OBS-URL: https://build.opensuse.org/request/show/1222140
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=6
 2024-11-13 18:49:50 +00:00
Christian Goll
40dd8143cd Accepting request 1194910 from home:uncomfyhalomacro:branches:science:machinelearning 
OBS-URL: https://build.opensuse.org/request/show/1194910
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=2
 2024-08-20 12:45:40 +00:00