Guang Yee 995fdb6bb1 - Update to version 0.21.0: ...

* More cache options.
  * Disable caching for long strings.
  * Testing ABI3 wheels to reduce number of wheels
  * Adding an API for decode streaming.
  * Decode stream python
  * Fix encode_batch and encode_batch_fast to accept ndarrays again

OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8

2024-12-18 17:58:42 +00:00

503 B

Raw Permalink Blame History

View Raw