17
0

- Update to 0.21.1:

* Update dev version and pyproject.toml
  * Add feature flag hint to README.md
  * Upgrade to PyO3 0.23
  * Fixing the README.md
  * Fix typo in Split docstrings
  * Fix typos
  * Update documentation of Rust feature
  * Fix panic in DecodeStream::step due to incorrect index usage
  * Fixing the stream by removing the read_index altogether
  * Fixing NormalizedString append when normalized is empty
  * Update metadata as Python3.7 and Python3.8 support was dropped
  * Add rustls-tls feature
- Remove define skip_python313 1

OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=13
This commit is contained in:
2025-03-25 08:40:26 +00:00
committed by Git OBS Bridge
parent f1cddf0be1
commit 4e353ff28b
5 changed files with 24 additions and 8 deletions

View File

@@ -16,15 +16,13 @@
#
%define skip_python313 1
%if 0%{?suse_version} && 0%{?suse_version} < 1550
%global force_gcc_version 13
%endif
%{?sle15_python_module_pythons}
Name: python-tokenizers
Version: 0.21.0
Version: 0.21.1
Release: 0
Summary: Provides an implementation of today's most used tokenizers
License: Apache-2.0