Guang Yee 82d122dfa5 Accepting request 1231910 from home:uncomfyhalomacro:branches:science:machinelearning ...

- Update to version 0.21.0:
  * More cache options.
  * Disable caching for long strings.
  * Testing ABI3 wheels to reduce number of wheels
  * Adding an API for decode streaming.
  * Decode stream python
  * Fix encode_batch and encode_batch_fast to accept ndarrays again

OBS-URL: https://build.opensuse.org/request/show/1231910
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8

2024-12-18 17:58:42 +00:00

3.4 KiB

Raw Blame History

View Raw