python-tokenizers/tokenizers-0.21.1.tar.gz at leap-16.1 - python-tokenizers - openSUSE Gitea

pool/python-tokenizers

SHA256

Files

Guillaume GARDET 4e353ff28b - Update to 0.21.1:

* Update dev version and pyproject.toml
  * Add feature flag hint to README.md
  * Upgrade to PyO3 0.23
  * Fixing the README.md
  * Fix typo in Split docstrings
  * Fix typos
  * Update documentation of Rust feature
  * Fix panic in DecodeStream::step due to incorrect index usage
  * Fixing the stream by removing the read_index altogether
  * Fixing NormalizedString append when normalized is empty
  * Update metadata as Python3.7 and Python3.8 support was dropped
  * Add rustls-tls feature
- Remove define skip_python313 1

OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=13

2025-03-25 08:40:26 +00:00

4 lines

132 BLFS

Plaintext

Raw Permalink Blame History

	`version https://git-lfs.github.com/spec/v1`
	`oid sha256:65dd1f079404161321ece0d1af4f678e5846e3e6056f004600bde776d489bddc`
	`size 1545849`