* Update dev version and pyproject.toml * Add feature flag hint to README.md * Upgrade to PyO3 0.23 * Fixing the README.md * Fix typo in Split docstrings * Fix typos * Update documentation of Rust feature * Fix panic in DecodeStream::step due to incorrect index usage * Fixing the stream by removing the read_index altogether * Fixing NormalizedString append when normalized is empty * Update metadata as Python3.7 and Python3.8 support was dropped * Add rustls-tls feature - Remove define skip_python313 1 OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=13
5.4 KiB
5.4 KiB