fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context #2790
This workflow is awaiting approval from a maintainer in #1798
Triggered via pull request
October 15, 2024 15:30
gjpower
Status
Action required
Total duration
–
Artifacts
–
This workflow is awaiting approval from a maintainer in #1798
test.yaml
on: pull_request
download-model
build-macos-metal
Matrix: build-linux
Waiting for pending jobs
Matrix: build-macos
Waiting for pending jobs
Matrix: build-windows
Waiting for pending jobs