Guang Yee
|
995fdb6bb1
|
- Update to version 0.21.0:
* More cache options.
* Disable caching for long strings.
* Testing ABI3 wheels to reduce number of wheels
* Adding an API for decode streaming.
* Decode stream python
* Fix encode_batch and encode_batch_fast to accept ndarrays again
OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8
|
2024-12-18 17:58:42 +00:00 |
|