registry.tar.zst

version https://git-lfs.github.com/spec/v1
oid sha256:f91a949651901dc59bc4ca7641ef392d61e6927f0bcf6820d088d6206c7e72c2
size 51237248
- Update to 0.21.4 * No change, the 0.21.3 release failed, this is just a re-release - from version 0.21.3 * Clippy fixes * Fixed an introduced backward breaking change in our Rust APIs. - from version 0.21.2 * Update the release builds following 0.21.1 * Replace lazy_static with stabilized std::sync::LazyLock in 1.80 * Fix no-onig no-wasm builds * Fix typos in strings and comments * Fix type notation of merges in BPE Python binding * Bump http-proxy-middleware from 2.0.6 to 2.0.9 in /tokenizers/examples/unstable_wasm/www * Fix data path in test_continuing_prefix_trainer_mismatch * clippy by @ArthurZucker * Update pyo3 and rust-numpy depends for no-gil/free-threading compat * Use ApiBuilder::from_env() in from_pretrained function * Upgrade onig, to get it compiling with GCC 15 * Itertools upgrade * Bump webpack-dev-server from 4.10.0 to 5.2.1 in /tokenizers/examples/unstable_wasm/www * Bump brace-expansion from 1.1.11 to 1.1.12 in /bindings/node * Fix features blending into a paragraph * Adding throughput to benches to have a more consistent measure across * Upgrading dependencies * [docs] Whitespace * Hotfixing the stub * Bpe clones * Fixed Length Pre-Tokenizer * Consolidated optimization ahash dary compact str OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-tokenizers?expand=0&rev=15 2025-09-15 09:32:28 +00:00			`version https://git-lfs.github.com/spec/v1`
			`oid sha256:f91a949651901dc59bc4ca7641ef392d61e6927f0bcf6820d088d6206c7e72c2`
			`size 51237248`