chore: update tiktoken to 0.8 to support py3.13 build

[chenrui333]

update tiktoken to 0.8 to support py3.13 build

tiktoken 0.8.0 changelog notes, https://github.com/openai/tiktoken/blob/main/CHANGELOG.md#v080

relates to Homebrew/homebrew-core#194427

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to ed914c7 in 11 seconds

More details

• Looked at 13 lines of code in 1 files
• Skipped 1 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. pyproject.toml:26

• Draft comment:
  Ensure compatibility with tiktoken 0.8.0 by reviewing its changelog for any breaking changes or necessary adjustments in the codebase.
• Reason this comment was not posted:
  Confidence changes required: 33%
  The PR updates the tiktoken dependency from version 0.7 to 0.8. This change is straightforward and aligns with the PR description, which mentions the need to support Python 3.13 builds. The changelog for tiktoken 0.8.0 should be reviewed to ensure compatibility and no breaking changes, but this is not part of the code review process. The rest of the pyproject.toml file remains unchanged, which is expected for this PR.

Workflow ID: wflow_cgK4lgsHfKzKEpWN

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[chenrui333]

actually also need huggingface/tokenizers#1639