82d122dfa526e379d7e259f0061c12909fe2e098d64cdd7fd63edc28798bd2e5
- Update to version 0.21.0: * More cache options. * Disable caching for long strings. * Testing ABI3 wheels to reduce number of wheels * Adding an API for decode streaming. * Decode stream python * Fix encode_batch and encode_batch_fast to accept ndarrays again OBS-URL: https://build.opensuse.org/request/show/1231910 OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=8
Description
No description provided
Languages
XML
100%