Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

when i run run.bat with botchat and TTS #84

Open
pnknguyen27 opened this issue Nov 18, 2023 · 11 comments
Open

when i run run.bat with botchat and TTS #84

pnknguyen27 opened this issue Nov 18, 2023 · 11 comments

Comments

@pnknguyen27
Copy link

image

@pnknguyen27
Copy link
Author

do you know how to fix this problem, thank you.

@Rubiksman78
Copy link
Owner

Did you download the chatbot model as explained in the wiki page here ? The current setup of chatbots is currently being completely changed but if you want to use it now, just follow the instructions on the link.

@pnknguyen27
Copy link
Author

i had downloaded Pygmalion like the wiki page and put the folder created in chatbot_models in the Monik.A.I folder yet., even setuptext-generation-webui.

@Rubiksman78
Copy link
Owner

The new setup isn't ready yet with text-generation-webui. However, if you put the whole folder for the Pygmalion model in chatbot_models, it should work with the current version.

@pnknguyen27
Copy link
Author

how about the cudNN, i have downloaded it but not install yet. Does it affect on process? thank you.

@pnknguyen27
Copy link
Author

i think i must try another model like RWKV.

@Rubiksman78
Copy link
Owner

The setup of CUDA is indeed important if you're trying to use local chatbots but it is not related to the previous error which was about a missing file from the chatbot.

@pnknguyen27
Copy link
Author

after use RWKV model, look like error like you said above, relate to CUDA
image

@Rubiksman78
Copy link
Owner

Okay then continue to follow the previous link about the installation of CUDA and don't forget to run setup_gpu.bat in last before running it again.

@pnknguyen27
Copy link
Author

it's still this error although i have install like the tutorial
image
and i have check the cuda

image

@Rubiksman78
Copy link
Owner

As I said before, the setup with text-generation-webui is not ready and even more not with RWKV which is using a different pipeline of generation. Please refer only and only to the link I've linked before, downloading the model and running setup_gpu.bat.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants