Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote LLM only supporting one chat. #436

Open
Jflick58 opened this issue Oct 8, 2024 · 2 comments
Open

Remote LLM only supporting one chat. #436

Jflick58 opened this issue Oct 8, 2024 · 2 comments

Comments

@Jflick58
Copy link

Jflick58 commented Oct 8, 2024

Describe the bug
I have a remote LLM that is our internal proxy for Azure OpenAI and Google Gemini. I have configured it properly as it does occasionally work. However, I often get an error pop up:

Error: LLM not found. Stack Trace: Error: LLM not found. at QA (file:///Applications/Reor.app/Contents/Resources/app.asar/dist/assets/index-92e5223c.js:148:644) at async O (file:///Applications/Reor.app/Contents/Resources/app.asar/dist/assets/index-92e5223c.js:259:6679)

To Reproduce
Steps to reproduce the behavior:

  1. Setup Remote LLM (proxied Azure OpenAI GPT-4o)
  2. Set default llm to GPT-4o
  3. Start a chat. (it will work)
  4. Start a new chat with that same LLM (or switch between chats)
  5. See error.

Expected behavior
Chats should function independently so that I can switch LLMs or have multiple separate chats with the same LLM.

Barring that, exposing logs or a more informative error message would be helpful.

Screenshots

Desktop (please complete the following information):

  • OS: MacOS
  • Hardware: MacBook Pro 14-inch, 2021 (M1 Pro 10 core), 16 GB ram
  • Version: Sonoma 14.6.1

Additional context
Love the tool and hope to contribute when I get some free time!

@Jflick58
Copy link
Author

Jflick58 commented Oct 9, 2024

I did some additional investigation: Running multiple chats is not a problem in v.0.2.19.

@samlhuillier
Copy link
Collaborator

Hey thanks for reporting this @Jflick58

I've tried to reproduce it haven't been able to do so so I have two suggestions to try see if we can fix this:

  1. Download v0.2.24 and see if that fixes things
  2. If not, I'd suggest we try clearing your local store state (beware that this will delete all chats you have made in Reor). You can do this:

Clone repo:

git clone https://github.com/reorproject/reor.git

Install dependencies:

Make sure you have nodejs installed.

npm install

Inside of electron/main/index.ts uncomment line 23 so that line 23 should look like this:

store.clear() // clear store for testing CAUTION: THIS WILL DELETE YOUR CHAT HISTORY

Run for dev:

npm run dev

After doing the above, Reor will open in dev as if it were a fresh install. You can then close the dev version and reopen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants