pool/python-transformers
SHA256
17
0
Fork 0
Code Issues Pull Requests Activity

Add patch 0001-Remove-upper-bound-for-tokenizers.patch

Browse Source 
* Remove upper bound for tokenizers

OBS-URL: https://build.opensuse.org/package/show/science:machinelearning/python-transformers?expand=0&rev=7
This commit is contained in:
Yogalakshmi Arunachalam
2024-10-28 15:22:05 +00:00
committed by Git OBS Bridge
parent 7d97d517b0
commit 11614dbc91
3 changed files with 48 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

39
0001-Remove-upper-bound-for-tokenizers.patch Normal file
View File

@@ -0,0 +1,39 @@
From e45fa5da9edaaa27a417e0d1e695bd81b2b29ac5 Mon Sep 17 00:00:00 2001
From: yeey <gyee@suse.com>
Date: Mon, 7 Oct 2024 18:52:19 -0700
Subject: [PATCH] Remove upper bound for tokenizers
---
setup.py | 2 +-
src/transformers/dependency_versions_table.py | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/setup.py b/setup.py
index b1547e2e5..b44844128 100644
--- a/setup.py
+++ b/setup.py
@@ -178,7 +178,7 @@ _deps = [
"tf2onnx",
"timeout-decorator",
"timm<=0.9.16",
- "tokenizers>=0.19,<0.20",
+ "tokenizers>=0.19",
"torch",
"torchaudio",
"torchvision",
diff --git a/src/transformers/dependency_versions_table.py b/src/transformers/dependency_versions_table.py
index 7644d8d68..c99c8b1b2 100644
--- a/src/transformers/dependency_versions_table.py
+++ b/src/transformers/dependency_versions_table.py
@@ -83,7 +83,7 @@ deps = {
"tf2onnx": "tf2onnx",
"timeout-decorator": "timeout-decorator",
"timm": "timm<=0.9.16",
- "tokenizers": "tokenizers>=0.19,<0.20",
+ "tokenizers": "tokenizers>=0.19",
"torch": "torch",
"torchaudio": "torchaudio",
"torchvision": "torchvision",
--
2.45.2

6
python-transformers.changes
View File

@@ -1,3 +1,9 @@
-------------------------------------------------------------------
Tue Oct 8 02:01:18 UTC 2024 - Guang Yee <gyee@suse.com>
- Add patch 0001-Remove-upper-bound-for-tokenizers.patch
* Remove upper bound for tokenizers
-------------------------------------------------------------------
Wed Sep 11 04:39:06 UTC 2024 - Yogalakshmi Arunachalam <yarunachalam@suse.com>

4
python-transformers.spec
View File

@@ -24,7 +24,8 @@ Summary: State-of-the-art Machine Learning for JAX, PyTorch and TensorFlo
License: Apache-2.0
URL: https://github.com/huggingface/transformers
Source: https://github.com/huggingface/transformers/archive/refs/tags/v%{version}.tar.gz#/%{name}-%{version}.tar.gz
Source99: python-transformers.rpmlintrc
Source99: python-transformers.rpmlintrc
Patch0: 0001-Remove-upper-bound-for-tokenizers.patch
BuildRequires: python-rpm-macros
BuildRequires: %{python_module setuptools}
BuildRequires: %{python_module filelock}
@@ -435,6 +436,7 @@ These models can be applied on:
%prep
%setup -q -n transformers-%{version}
%autopatch -p1
# fix shebang
find . -name \*.py -type f -exec \
sed -i "s|^#!\s*%{_bindir}/env python|#!%{_bindir}/python3|" {} \;