python-tiktoken/_servicedata

<servicedata>
<service name="tar_scm">
                <param name="url">https://github.com/openai/tiktoken.git</param>
              <param name="changesrevision">63527649963def8c759b0f91f2eb69a40934e468</param></service></servicedata>
- Update to version 0.8.0: * Alas, emulation * Attempt to fix emulated builds * Partial sync of codebase * Add possessive quantifiers to avoid catastrophic backtracking (#258) * update README to mention gpt-4o * Sync codebase * Simplify byte_pair_merge (#255) * Inline custom mapping function in _byte_pair_merge * Avoid calling byte_pair_encode for existing tokens * Performance improvements OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-tiktoken?expand=0&rev=5 2024-11-21 09:21:27 +00:00			`<servicedata>`
			`<service name="tar_scm">`
			`<param name="url">https://github.com/openai/tiktoken.git</param>`
			`<param name="changesrevision">63527649963def8c759b0f91f2eb69a40934e468</param></service></servicedata>`