Skip to content

Pull requests: abetlen/llama-cpp-python

New pull request New
71 Open 399 Closed
71 Open 399 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix type hint for logit_bias parameter
#1802 opened Oct 16, 2024 by ddh0 Loading…
fix: additional_files support glob patterns
#1800 opened Oct 16, 2024 by xianml Loading…
fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context
#1798 opened Oct 15, 2024 by gjpower Loading…
fix: added missing exit_stack.close() to /v1/chat/completions
#1796 opened Oct 14, 2024 by Ian321 Loading…
1
1
Fix: Refactor Batching notebook to use new sampler chain API
#1793 opened Oct 13, 2024 by lukestanley Loading…
1
Fixed typo at line 340 of README.md
#1791 opened Oct 9, 2024 by Victoran0 Loading…
6
chore(deps): bump pypa/cibuildwheel from 2.21.1 to 2.21.3 dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#1790 opened Oct 9, 2024 by dependabot bot Loading…
fix: chat API logprobs format
#1788 opened Oct 6, 2024 by domdomegg Loading…
1
2
server types: Move 'model' parameter to clarify it is used
#1786 opened Oct 5, 2024 by domdomegg Loading…
Fix LLAVA_CPP_LIB creating empty path
#1782 opened Oct 3, 2024 by navratil-matej Loading…
Add Paligemma support
#1777 opened Oct 2, 2024 by abetlen • Draft
Update Dockerfile
#1776 opened Oct 1, 2024 by Smartappli Loading…
1
Add support for Cuda 12.6
#1775 opened Oct 1, 2024 by Smartappli Loading…
fix: handle multiple calls to the same tool
#1758 opened Sep 24, 2024 by jeffmaury Loading…
1
corrected command
#1739 opened Sep 12, 2024 by Shehrozkashif Loading…
Resync llama_grammar with llama.cpp implementation and use curly braces quantities instead of repetitions
#1721 opened Aug 31, 2024 by gbloisi-openaire Loading…
Remove unnecessary pyproject optional dependency
#1718 opened Aug 30, 2024 by LecrisUT Loading…
feat: adding support for external chat format contribution
#1716 opened Aug 29, 2024 by axel7083 Loading…
1
Allow server to accept openai's new structured output "json_schema" format.
#1677 opened Aug 13, 2024 by cerealbox Loading…
🚀 Add Ruff Linter
#1651 opened Aug 2, 2024 by Smartappli Loading…
3
Updated README.md, llama_cpp/llama.py and pyproject.toml to add support for cross-encoders
#1605 opened Jul 17, 2024 by perpendicularai Loading…
1
Support images from local storage for Llava models
#1583 opened Jul 9, 2024 by GokulMuraliRajasekar Loading…
1
Add stream_options support according to OpenAI API
#1552 opened Jun 25, 2024 by tpfau Loading…
1
13
Change server approach to handle parallel requests
#1550 opened Jun 24, 2024 by sergey-zinchenko Loading…
6
Support all types of GGUF metadata
#1525 opened Jun 13, 2024 by ddh0 Loading…
1
ProTip! Follow long discussions with comments:>50.